00000001:02000400:3.0F:1790971509.035962:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_hostid 00000001:02000400:3.0:1790971528.999298:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1790971531.045166:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 541 MB/s 00000001:01000000:0.0:1790971531.297621:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 636 MB/s 00000001:01000000:2.0F:1790971531.547656:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2935 MB/s 00000020:02000000:2.0:1790971532.295692:0:3271:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_2_g3d9f037 00000400:02000000:0.0:1790971533.262590:0:3286:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.143@tcp [8/256/0/180] 00008000:02000000:3.0:1790971537.256631:0:3436:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1790971585.940270:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790971595.763913:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790971595.763919:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790971595.764071:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002fd90f9f 00000080:02000400:2.0:1790971595.764082:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:2.0:1790971595.771786:0:5820:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790971595.771800:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790971595.771842:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ada0590d) 00000020:00000080:2.0:1790971595.771863:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790971595.797002:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790971595.797403:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790971595.862816:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790971595.862872:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790971595.862896:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790971595.862947:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790971595.862989:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790971595.863914:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790971595.863923:0:5820:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790971595.863934:0:5820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f49226 00000020:01000004:3.0:1790971595.863943:0:5820:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790971595.863947:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790971595.863952:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002fd90f9f from MGS 00000020:01000004:3.0:1790971595.863956:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790971595.863980:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000062464942) 00000020:00000080:3.0:1790971595.863993:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790971595.864370:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002fd90f9f from MGS, refs=2 00080000:01000000:3.0:1790971595.864378:0:5820:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790971595.864383:0:5820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f49234 00000100:00100000:3.0:1790971595.864550:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790971595.864695:0:5820:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790971595.864702:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790971595.865704:0:5820:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790971595.865714:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790971595.867387:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971595.867661:0:5820:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790971595.867668:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790971595.869750:0:5820:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790971595.869773:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790971595.870359:0:5820:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790971595.870368:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790971595.871219:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971595.871223:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971595.871225:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971595.871512:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971595.871515:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971595.871523:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971595.872392:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790971595.878751:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790971596.121611:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2883 MB/s 00000001:01000000:0.0:1790971596.373642:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2884 MB/s 00000001:01000000:2.0:1790971596.625828:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 642 MB/s 00000001:01000000:3.0:1790971596.875609:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 887 MB/s 00080000:10000000:3.0:1790971596.887888:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1790971596.901649:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790971596.912004:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790971596.912022:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790971596.912025:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790971596.913254:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790971596.913286:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790971596.913341:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790971596.913569:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790971596.913590:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790971596.914014:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971596.914216:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790971596.914222:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790971596.914692:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790971596.914699:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790971596.919346:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790971596.919359:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790971596.921439:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:2.0:1790971596.921535:0:5835:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1790971596.922191:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:1.0:1790971596.922194:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790971596.922387:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:1.0:1790971596.922415:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (00000000d8822f54) 00000020:00000080:1.0:1790971596.922436:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790971596.922562:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001d682971@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1790971596.922719:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:1.0:1790971596.922725:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 10000000:01000000:1.0:1790971596.922954:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790971596.922982:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid a0404db5-d37b-41bb-8054-1f8859117a4f) 00000020:00000080:1.0:1790971596.922995:0:5820:0:(genops.c:1384:class_connect()) connect: client a0404db5-d37b-41bb-8054-1f8859117a4f, cookie 0xbd3388eaa6f49242 00000100:00080000:1.0:1790971596.923003:0:5820:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790971596.923010:0:5820:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import 000000001d682971 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971596.923046:0:5820:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e33e796c x1877969766187136/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790971596.923064:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a0404db5-d37b-41bb-8054-1f8859117a4f->MGS 00000020:01000004:1.0:1790971596.923078:0:5820:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790971596.923083:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:3.0:1790971596.923678:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e33e796c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0404db5-d37b-41bb-8054-1f8859117a4f:3301:1877969766187136:0@lo:250: 00000100:00100000:3.0:1790971596.923747:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971596.923823:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766187136 00000100:00100000:3.0:1790971596.923830:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766187136 00000100:00100000:3.0:1790971596.923858:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971596.923865:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008769ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1877969766187136:12345-0@lo:250: 00010000:00080000:3.0:1790971596.923888:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from a0404db5-d37b-41bb-8054-1f8859117a4f@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1790971596.923909:0:5831:0:(genops.c:1384:class_connect()) connect: client a0404db5-d37b-41bb-8054-1f8859117a4f, cookie 0xbd3388eaa6f49249 00000100:00080000:3.0:1790971596.924037:0:5831:0:(import.c:65:import_set_state_nolock()) 00000000ee96ebc2 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790971596.924086:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008769ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+5:3301:x1877969766187136:12345-0@lo:250: Request processed in 220us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971596.925191:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:1.0:1790971596.926233:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000000a0b17e) 00000100:00100000:3.0:1790971596.926368:0:3301:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790971596.926381:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:3.0:1790971596.926391:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790971596.926396:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790971596.926400:0:3301:0:(import.c:65:import_set_state_nolock()) 000000001d682971 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790971596.926402:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790971596.926417:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790971596.926425:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e33e796c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0404db5-d37b-41bb-8054-1f8859117a4f:3301:1877969766187136:0@lo:250: 00000020:00000080:1.0:1790971596.926637:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790971596.953852:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971596.954065:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790971596.954071:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790971596.955325:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790971596.955336:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790971596.955898:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790971596.955911:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790971596.960930:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971596.961126:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790971596.961133:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790971596.961990:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790971596.961998:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790971597.020434:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971597.020768:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790971597.020775:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790971597.022190:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790971597.022312:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790971597.023188:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971597.023726:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790971597.023732:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790971597.024396:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790971597.024403:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790971597.031589:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971597.031768:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790971597.031774:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790971597.035414:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790971597.035547:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790971597.036802:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790971597.036996:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790971597.037001:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790971597.037737:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790971597.037745:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790971597.061002:0:5820:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790971597.061310:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790971597.061317:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790971597.063185:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790971597.063308:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790971597.064364:0:5820:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790971597.064372:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790971597.069195:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790971597.069232:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1790971597.069238:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790971597.069818:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790971597.069911:0:5820:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1790971597.069916:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790971597.069917:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790971597.069918:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790971597.069919:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790971597.069920:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790971597.069921:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790971597.069923:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790971597.069924:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790971597.069925:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790971597.069926:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790971597.069928:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790971597.069929:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790971597.069932:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1790971597.069934:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790971597.069935:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790971597.069936:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790971597.069937:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790971597.069938:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790971597.069939:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790971597.069939:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790971597.069940:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790971597.069941:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790971597.069942:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790971597.069943:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790971597.069944:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790971597.069977:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790971597.069994:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8f0d12f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187264:0@lo:253: 00000100:00100000:1.0:1790971597.070077:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971597.070199:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2879413 going to sleep for 11 seconds 00000100:00100000:2.0:1790971597.070400:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766187264 00000100:00100000:2.0:1790971597.070409:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766187264 00000100:00100000:2.0:1790971597.070640:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971597.070650:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000515f8b33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+5:5820:x1877969766187264:12345-0@lo:253: 20000000:01000000:2.0:1790971597.070697:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790971597.070700:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1790971597.071201:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790971597.071376:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790971597.071755:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790971597.072822:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1790971597.073924:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790971597.073930:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1790971597.073935:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1790971597.073938:0:5834:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1790971597.073952:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1790971597.074151:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790971597.074709:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1790971597.074726:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790971597.074779:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1790971597.074830:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1790971597.074869:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1790971597.075142:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1790971597.075151:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1790971597.075322:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1790971597.075334:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1790971597.075372:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1790971597.075379:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1790971597.075409:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1790971597.075631:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1790971597.075670:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790971597.075675:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1790971597.075687:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790971597.075978:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1790971597.075989:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790971597.076040:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1790971597.076075:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1790971597.076126:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1790971597.076139:0:5834:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1790971597.076366:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1790971597.076375:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790971597.076625:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1790971597.076676:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1790971597.076712:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1790971597.076723:0:5834:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1790971597.076806:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1790971597.076815:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1790971597.076847:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1790971597.076959:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1790971597.077152:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1790971597.077349:0:5834:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1790971597.077357:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1790971597.078176:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1790971597.078705:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1790971597.078729:0:5834:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.143@tcp for mdt 20000000:01000000:2.0:1790971597.078732:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:2.0:1790971597.078771:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1790971597.078778:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790971597.078805:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1790971597.078812:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:2.0:1790971597.078853:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1790971597.078864:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1790971597.078973:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1790971597.079028:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1790971597.079090:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790971597.079093:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790971597.079099:0:5834:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1790971597.079105:0:5834:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1790971597.079977:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1790971597.080113:0:5834:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1790971597.102290:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1790971597.102345:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1790971597.102436:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1790971597.102466:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790971597.102494:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790971597.102499:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790971597.102512:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790971597.102514:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790971597.105237:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790971597.105246:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790971597.107897:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1790971597.108345:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1790971597.108400:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1790971597.110011:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1790971597.110043:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790971597.110046:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790971597.110814:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1790971597.111364:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790971597.111413:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790971597.111449:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1790971597.111772:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790971597.111774:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1790971597.111781:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790971597.111929:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111947:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111955:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111961:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111967:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111972:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111977:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e835a8a6 already unused, calling callback (00000000ed3e1777) 00010000:00010000:1.0:1790971597.111981:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111987:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.111998:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.112004:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.112008:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e835a8a6/0xbd3388eaa6f49257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790971597.112037:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790971597.359902:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000515f8b33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+5:5820:x1877969766187264:12345-0@lo:253: Request processed in 289248us (289819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971597.359917:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971597.360012:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8f0d12f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187264:0@lo:253: 10000000:01000000:1.0:1790971597.360026:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790971597.360029:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790971597.360031:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790971597.360033:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790971597.360034:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1790971597.360035:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790971597.360037:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790971597.360038:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790971597.360039:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790971597.360041:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790971597.360042:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790971597.360044:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790971597.360061:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002fd90f9f from lustre-MDT0000 10000000:01000000:1.0:1790971597.360088:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790971597.360091:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790971597.360096:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cd48794cd40 10000000:01000000:1.0:1790971597.360100:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790971597.360108:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cd48794cd40 from 1 10000000:01000000:1.0:1790971597.360112:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790971597.360151:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000e835a8a6/0xbd3388eaa6f4925e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.360162:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000e835a8a6/0xbd3388eaa6f4925e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.360170:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000e835a8a6/0xbd3388eaa6f4925e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971597.360258:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8f0d12f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187392:0@lo:101: 00000100:00100000:1.0:1790971597.360312:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971597.360365:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb3c69a7 going to sleep for 11 seconds 00000100:00100000:3.0:1790971597.360663:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766187392 00000100:00100000:3.0:1790971597.360670:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766187392 00000100:00100000:3.0:1790971597.360718:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790971597.360726:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005aa13e91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+5:5820:x1877969766187392:12345-0@lo:101: 00010000:00010000:3.0:1790971597.360739:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971597.360754:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032c47070/0xbd3388eaa6f49265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4925e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971597.360776:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032c47070/0xbd3388eaa6f49265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971597.360786:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032c47070/0xbd3388eaa6f49265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971597.360794:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032c47070, rc 0) 00000100:00100000:3.0:1790971597.360827:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005aa13e91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+6:5820:x1877969766187392:12345-0@lo:101: Request processed in 102us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971597.360833:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790971597.360953:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8f0d12f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187392:0@lo:101: 00010000:00010000:1.0:1790971597.360967:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000e835a8a6/0xbd3388eaa6f4925e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.360975:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000e835a8a6/0xbd3388eaa6f4925e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971597.361022:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8f0d12f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187520:0@lo:501: 00000100:00100000:1.0:1790971597.361048:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971597.361074:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb3c69a7 going to sleep for 11 seconds 00000100:00100000:3.0:1790971597.361120:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766187520 00000100:00100000:3.0:1790971597.361125:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766187520 00000100:00100000:3.0:1790971597.361191:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790971597.361198:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000034138373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+6:5820:x1877969766187520:12345-0@lo:501: 00000100:00100000:3.0:1790971597.361431:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000034138373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+6:5820:x1877969766187520:12345-0@lo:501: Request processed in 233us (382us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790971597.361438:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790971597.361535:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8f0d12f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187520:0@lo:501: 10000000:01000000:2.0:1790971597.361571:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790971597.361585:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000e835a8a6/0xbd3388eaa6f4925e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.361594:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000e835a8a6/0xbd3388eaa6f4925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971597.361613:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cd4b52bc800 10000000:01000000:2.0:1790971597.361617:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790971597.361621:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cd4b52bc800 10000000:01000000:2.0:1790971597.361624:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790971597.361627:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cd4b52bc800 from 1 10000000:01000000:2.0:1790971597.361629:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790971597.361660:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000c2e53676/0xbd3388eaa6f4926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.361667:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000c2e53676/0xbd3388eaa6f4926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.361672:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000c2e53676/0xbd3388eaa6f4926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971597.361683:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187648:0@lo:101: 00000100:00100000:2.0:1790971597.361723:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.362113:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d558715 going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.362249:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766187648 00000100:00100000:1.0:1790971597.362255:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766187648 00000100:00100000:1.0:1790971597.362280:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790971597.362287:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000447605c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+6:5820:x1877969766187648:12345-0@lo:101: 00010000:00010000:1.0:1790971597.362295:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971597.362305:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e901f0d4/0xbd3388eaa6f49273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4926c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.362318:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e901f0d4/0xbd3388eaa6f49273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4926c expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.362324:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e901f0d4/0xbd3388eaa6f49273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4926c expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.362328:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e901f0d4, rc 0) 00000100:00100000:1.0:1790971597.362399:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000447605c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+7:5820:x1877969766187648:12345-0@lo:101: Request processed in 113us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.362418:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790971597.362755:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187648:0@lo:101: 00010000:00010000:2.0:1790971597.362768:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000c2e53676/0xbd3388eaa6f4926c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.362776:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000c2e53676/0xbd3388eaa6f4926c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971597.362788:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790971597.362794:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000c2e53676/0xbd3388eaa6f4926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.363050:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000c2e53676/0xbd3388eaa6f4926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971597.363057:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790971597.363061:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790971597.363065:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cd4b52bc800 10000000:01000000:2.0:1790971597.363068:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790971597.363071:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790971597.363073:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790971597.363091:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000084e50131/0xbd3388eaa6f4927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.363096:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000084e50131/0xbd3388eaa6f4927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.363102:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000084e50131/0xbd3388eaa6f4927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971597.363115:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187776:0@lo:101: 00000100:00100000:2.0:1790971597.363147:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.363176:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d558715 going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.363261:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766187776 00000100:00100000:1.0:1790971597.363266:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766187776 00000100:00100000:1.0:1790971597.363332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790971597.363341:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e71ee6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+7:5820:x1877969766187776:12345-0@lo:101: 00010000:00010000:1.0:1790971597.363350:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971597.363360:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056e5a3c5/0xbd3388eaa6f49281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4927a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.363376:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056e5a3c5/0xbd3388eaa6f49281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.363383:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056e5a3c5/0xbd3388eaa6f49281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.363390:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056e5a3c5, rc 0) 00000100:00100000:1.0:1790971597.363695:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e71ee6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+8:5820:x1877969766187776:12345-0@lo:101: Request processed in 355us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.363702:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790971597.364008:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187776:0@lo:101: 00010000:00010000:2.0:1790971597.364020:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000084e50131/0xbd3388eaa6f4927a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.364028:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000084e50131/0xbd3388eaa6f4927a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971597.364089:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187904:0@lo:501: 00000100:00100000:2.0:1790971597.364118:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.364250:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d558715 going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.364296:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766187904 00000100:00100000:1.0:1790971597.364301:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766187904 00000100:00100000:1.0:1790971597.364370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790971597.364377:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000090ab34e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+8:5820:x1877969766187904:12345-0@lo:501: 00000100:00100000:1.0:1790971597.364719:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000090ab34e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+9:5820:x1877969766187904:12345-0@lo:501: Request processed in 342us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.364726:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790971597.364866:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766187904:0@lo:501: 00000100:00100000:2.0:1790971597.364893:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188032:0@lo:503: 00000100:00100000:2.0:1790971597.364934:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.365071:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d558715 going to sleep for 11 seconds 00000100:00100000:3.0:1790971597.365153:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188032 00000100:00100000:3.0:1790971597.365159:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188032 00000100:00100000:3.0:1790971597.365244:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790971597.365252:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000eb1e85d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+9:5820:x1877969766188032:12345-0@lo:503: 00000100:00100000:2.0:1790971597.365494:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188032:0@lo:503: 00000100:00100000:2.0:1790971597.365695:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5862:1877969766188160:0@lo:502: 00000100:00100000:2.0:1790971597.365874:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.365893:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055f25d25 going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.365943:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188160 00000100:00100000:1.0:1790971597.365948:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188160 00000100:00100000:1.0:1790971597.365977:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790971597.365983:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003d72efc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+10:5862:x1877969766188160:12345-0@lo:502: 00000100:00100000:1.0:1790971597.366144:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003d72efc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+10:5862:x1877969766188160:12345-0@lo:502: Request processed in 161us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.366151:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790971597.366300:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5862:1877969766188160:0@lo:502: 00000020:01000000:2.0:1790971597.366323:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971597.366335:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971597.366337:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790971597.366342:0:5862:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790971597.366346:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790971597.366360:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000059305819) 00000020:00000080:2.0:1790971597.366376:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790971597.366381:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790971597.366497:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790971597.366505:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4928f 00000020:00000080:2.0:1790971597.366730:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790971597.366734:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971597.366737:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971597.366745:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790971597.366748:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971597.366751:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971597.366753:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790971597.366756:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790971597.366764:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000385cf151) 00000020:00000080:2.0:1790971597.366773:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790971597.366777:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790971597.366778:0:5862:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790971597.366782:0:5862:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790971597.366788:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790971597.366842:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002fd90f9f from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790971597.366857:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000033fc0974) 00000020:00000080:2.0:1790971597.366865:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790971597.366921:0:5862:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790971597.366927:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f492a4 00000020:00000080:2.0:1790971597.367032:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790971597.367039:0:5862:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790971597.367044:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbd3388eaa6f492ab 00080000:01000000:2.0:1790971597.367048:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790971597.367051:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f492b2 00080000:10000000:2.0:1790971597.367862:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1790971597.368067:0:5862:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 00000100:00100000:3.0:1790971597.370349:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000eb1e85d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+9:5820:x1877969766188032:12345-0@lo:503: Request processed in 5088us (5405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971597.370365:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 40000000:02000000:2.0:1790971597.374168:0:5862:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790971597.446170:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790971597.447249:0:5862:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790971597.450281:0:5862:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790971597.450903:0:5862:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790971597.498620:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b41e68db) 00000020:00000080:0.0:1790971597.498642:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790971597.498737:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790971597.498742:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f492c0 00000020:00000080:1.0:1790971597.501737:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1790971597.508170:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790971597.567971:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971597.608983:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971597.638734:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790971597.700008:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790971597.775759:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1790971597.812424:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbd3388eaa6f492c7 00000020:00000080:0.0:1790971597.812943:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790971597.812954:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971597.812960:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971597.812963:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790971597.812965:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790971597.812972:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971597.812973:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790971597.812977:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790971597.813010:0:5862:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790971597.813021:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971597.813024:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971597.813025:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790971597.813027:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790971597.813029:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971597.813030:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790971597.813033:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790971597.813034:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790971597.813088:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5862:1877969766188288:0@lo:502: 00000100:00100000:0.0:1790971597.813168:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971597.813226:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bcf70e2 going to sleep for 11 seconds 00000100:00100000:2.0:1790971597.813319:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188288 00000100:00100000:2.0:1790971597.813327:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188288 00000100:00100000:2.0:1790971597.813370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790971597.813378:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000acafc3b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+9:5862:x1877969766188288:12345-0@lo:502: 00000100:00100000:2.0:1790971597.813822:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000acafc3b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+9:5862:x1877969766188288:12345-0@lo:502: Request processed in 443us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971597.813830:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971597.813957:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5862:1877969766188288:0@lo:502: 00000020:01000000:0.0:1790971597.813979:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971597.813983:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971597.813985:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790971597.813987:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1790971597.814130:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1790971597.814149:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790971597.814199:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000084e50131/0xbd3388eaa6f4927a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.814211:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000084e50131/0xbd3388eaa6f4927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971597.814219:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd4b52bc800 from 1 10000000:01000000:2.0:1790971597.814222:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790971597.814249:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.814256:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.814263:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971597.814276:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188416:0@lo:101: 00000100:00100000:2.0:1790971597.814306:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.814341:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f56fa4c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971597.814639:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188416 00000100:00100000:0.0:1790971597.814645:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188416 00000100:00100000:0.0:1790971597.814673:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790971597.814679:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f93ba1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+9:5820:x1877969766188416:12345-0@lo:101: 00010000:00010000:0.0:1790971597.814692:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971597.814706:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f492ce expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.814728:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.814737:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.814745:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000077d06edb, rc 0) 00000100:00100000:0.0:1790971597.814777:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f93ba1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+10:5820:x1877969766188416:12345-0@lo:101: Request processed in 98us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971597.814782:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971597.814865:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188416:0@lo:101: 00010000:00010000:2.0:1790971597.814879:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.814887:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971597.815593:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188544:0@lo:256: 00000100:00100000:2.0:1790971597.815649:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.815685:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f56fa4c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.815764:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188544 00000100:00100000:1.0:1790971597.815771:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188544 00000100:00100000:1.0:1790971597.815810:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790971597.815817:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009ff99d7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+10:5820:x1877969766188544:12345-0@lo:256: 20000000:01000000:1.0:1790971597.815834:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790971597.815840:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790971597.815902:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009ff99d7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+10:5820:x1877969766188544:12345-0@lo:256: Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.815908:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971597.815982:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188544:0@lo:256: 10000000:01000000:2.0:1790971597.816777:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790971597.816910:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.816923:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971597.816932:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4b52bc800 from 1 10000000:01000000:2.0:1790971597.816935:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971597.816964:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.816971:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.816980:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971597.816996:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188672:0@lo:101: 00000100:00100000:2.0:1790971597.817039:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.817075:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f56fa4c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.817133:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188672 00000100:00100000:1.0:1790971597.817139:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188672 00000100:00100000:1.0:1790971597.817178:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790971597.817185:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000164e1924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+10:5820:x1877969766188672:12345-0@lo:101: 00010000:00010000:1.0:1790971597.817197:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971597.817210:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f492dc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.817230:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.817239:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.817258:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c50508a, rc 0) 00000100:00100000:1.0:1790971597.817303:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000164e1924 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5820:x1877969766188672:12345-0@lo:101: Request processed in 119us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.817309:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790971597.817378:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ba62c87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188672:0@lo:101: 00010000:00010000:0.0:1790971597.817390:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.817397:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971597.817603:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188800:0@lo:501: 00000100:00100000:0.0:1790971597.817631:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971597.817646:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010efbe81 going to sleep for 11 seconds 00000100:00100000:2.0:1790971597.817693:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188800 00000100:00100000:2.0:1790971597.817697:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188800 00000100:00100000:2.0:1790971597.817727:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790971597.817733:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f581b83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5820:x1877969766188800:12345-0@lo:501: 00000100:00100000:2.0:1790971597.818277:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f581b83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5820:x1877969766188800:12345-0@lo:501: Request processed in 543us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971597.818290:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790971597.818642:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188800:0@lo:501: 00000100:00100000:0.0:1790971597.818684:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188928:0@lo:503: 00000100:00100000:0.0:1790971597.818729:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971597.818758:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010efbe81 going to sleep for 11 seconds 00000100:00100000:2.0:1790971597.818820:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766188928 00000100:00100000:2.0:1790971597.818825:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766188928 00000100:00100000:2.0:1790971597.818859:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790971597.818866:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b311c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5820:x1877969766188928:12345-0@lo:503: 00000040:00080000:2.0:1790971597.818906:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790971597.818953:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b311c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5820:x1877969766188928:12345-0@lo:503: Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971597.818960:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790971597.819026:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766188928:0@lo:503: 00000040:00080000:1.0:1790971597.820104:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790971597.820379:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790971597.820702:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971597.820761:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.820773:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971597.820822:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790971597.820825:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cd4b52bc800 10000000:01000000:0.0:1790971597.820828:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cd4b52bc800 10000000:01000000:0.0:1790971597.820832:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790971597.820838:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4b52bc800 from 1 10000000:01000000:0.0:1790971597.820841:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790971597.820878:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000864f7e44/0xbd3388eaa6f492ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.820886:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000864f7e44/0xbd3388eaa6f492ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.820894:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000864f7e44/0xbd3388eaa6f492ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971597.820917:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189056:0@lo:101: 00000100:00100000:0.0:1790971597.820971:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971597.821020:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa6ee5ee going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.821063:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189056 00000100:00100000:1.0:1790971597.821071:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189056 00000100:00100000:1.0:1790971597.821139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790971597.821147:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000938622a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5820:x1877969766189056:12345-0@lo:101: 00010000:00010000:1.0:1790971597.821159:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971597.821172:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dff3d10d/0xbd3388eaa6f492f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f492ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.821192:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dff3d10d/0xbd3388eaa6f492f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.821200:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dff3d10d/0xbd3388eaa6f492f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.821207:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dff3d10d, rc 0) 00000100:00100000:1.0:1790971597.821250:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000938622a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5820:x1877969766189056:12345-0@lo:101: Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.821257:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790971597.821347:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189056:0@lo:101: 00010000:00010000:0.0:1790971597.821360:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000864f7e44/0xbd3388eaa6f492ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971597.821367:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000864f7e44/0xbd3388eaa6f492ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971597.821422:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189184:0@lo:501: 00000100:00100000:0.0:1790971597.821455:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971597.821686:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa6ee5ee going to sleep for 11 seconds 00000100:00100000:2.0:1790971597.821765:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189184 00000100:00100000:2.0:1790971597.821770:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189184 00000100:00100000:2.0:1790971597.821795:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790971597.821800:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000028e74c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5820:x1877969766189184:12345-0@lo:501: 00000100:00100000:2.0:1790971597.822063:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000028e74c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5820:x1877969766189184:12345-0@lo:501: Request processed in 262us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971597.822070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790971597.822141:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b5dd0b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189184:0@lo:501: 00000100:00100000:3.0:1790971597.822187:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7f8fb6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189312:0@lo:503: 00000100:00100000:3.0:1790971597.822228:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971597.822251:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ae58853 going to sleep for 11 seconds 00000100:00100000:2.0:1790971597.822297:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189312 00000100:00100000:2.0:1790971597.822301:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189312 00000100:00100000:2.0:1790971597.822320:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790971597.822326:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3baa9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5820:x1877969766189312:12345-0@lo:503: 00000100:00100000:2.0:1790971597.822846:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3baa9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5820:x1877969766189312:12345-0@lo:503: Request processed in 519us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971597.822855:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790971597.823022:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7f8fb6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189312:0@lo:503: 00000100:00100000:3.0:1790971597.823377:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7f8fb6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5867:1877969766189440:0@lo:502: 00000100:00100000:3.0:1790971597.823429:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.823654:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189440 00000100:00100000:2.0:1790971597.823660:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189440 00000100:00100000:2.0:1790971597.823693:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790971597.823700:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008e5cc254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5867:x1877969766189440:12345-0@lo:502: 00000100:00100000:2.0:1790971597.823912:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008e5cc254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5867:x1877969766189440:12345-0@lo:502: Request processed in 213us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971597.823919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790971597.824012:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 000000004849b109 going to sleep for 11 seconds 00000100:00100000:3.0:1790971597.824028:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7f8fb6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5867:1877969766189440:0@lo:502: 00000020:01000004:3.0:1790971597.824082:0:5867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790971597.824099:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000571d74be) 00000020:00000080:3.0:1790971597.824135:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1790971597.824215:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002fd90f9f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790971597.824224:0:5867:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002fd90f9f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790971597.824228:0:5867:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002fd90f9f 4 00010000:00080000:3.0:1790971597.824256:0:5867:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000055125b38@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1790971597.826160:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1790971597.826844:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790971597.826885:0:5867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790971597.826898:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbd3388eaa6f492ff 00000100:00080000:3.0:1790971597.826908:0:5867:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790971597.826920:0:5867:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000055125b38 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1790971597.826956:0:5867:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f7f8fb6f x1877969766189568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790971597.827011:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7f8fb6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766189568:0@lo:38: 00000100:00100000:2.0:1790971597.827088:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790971597.827183:0:5867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790971597.828571:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189568 00000100:00100000:2.0:1790971597.828582:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189568 00000100:00100000:2.0:1790971597.828692:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790971597.828699:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007d45d806 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1877969766189568:12345-0@lo:38: 00000100:00100000:2.0:1790971597.828864:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007d45d806 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1877969766189568:12345-0@lo:38: Request processed in 163us (1775us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790971597.828941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971597.829090:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790971597.829098:0:3301:0:(import.c:65:import_set_state_nolock()) 0000000055125b38 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790971597.829777:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790971597.829783:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7f8fb6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766189568:0@lo:38: 00000100:00100000:2.0:1790971597.832686:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082e7e206 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5867:1877969766189696:0@lo:502: 00000100:00100000:2.0:1790971597.832770:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.832804:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189696 00000100:00100000:2.0:1790971597.832810:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189696 00000100:00100000:2.0:1790971597.832858:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790971597.832866:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008ae094c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5867:x1877969766189696:12345-0@lo:502: 00000100:00100000:2.0:1790971597.833073:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008ae094c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5867:x1877969766189696:12345-0@lo:502: Request processed in 207us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971597.833081:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790971597.833142:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb3d2e6 going to sleep for 11 seconds 00000100:00100000:2.0:1790971597.833161:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082e7e206 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:5867:1877969766189696:0@lo:502: 00000040:00080000:2.0:1790971597.833183:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1790971597.833233:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790971597.833253:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790971597.833273:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000864f7e44/0xbd3388eaa6f492ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.833284:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000864f7e44/0xbd3388eaa6f492ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790971597.833327:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790971597.833329:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971597.833331:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971597.833333:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971597.833334:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971597.833336:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971597.833337:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971597.833338:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971597.833340:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971597.833341:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971597.833343:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971597.833344:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790971597.833348:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1790971597.833351:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790971597.833352:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971597.833353:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971597.833354:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971597.833355:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971597.833356:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971597.833357:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971597.833358:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971597.833359:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971597.833360:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971597.833361:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971597.833362:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790971597.833373:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790971597.833381:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082e7e206 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189824:0@lo:253: 00000100:00100000:2.0:1790971597.833419:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.833437:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb3d2e6 going to sleep for 11 seconds 00000100:00100000:1.0:1790971597.833935:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189824 00000100:00100000:1.0:1790971597.833943:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189824 00000100:00100000:1.0:1790971597.833987:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790971597.833995:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004269d86d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5820:x1877969766189824:12345-0@lo:253: 20000000:01000000:1.0:1790971597.834053:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790971597.834073:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790971597.888571:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790971597.888599:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790971597.888726:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790971597.888732:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790971597.888783:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.888802:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.888809:0:5854:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.888847:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971597.888864:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 12 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971597.888877:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000071f10cc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1877969766189952:0@lo:104: 00000100:00100000:2.0:1790971597.888940:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971597.889013:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060045c3c going to sleep for 11 seconds 00000100:00100000:3.0:1790971597.889165:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766189952 00000100:00100000:3.0:1790971597.889173:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766189952 00000100:00100000:3.0:1790971597.889223:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971597.889231:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c4afce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5854:x1877969766189952:12345-0@lo:104: 00010000:00010000:3.0:1790971597.889242:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971597.889304:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790971597.889310:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c4afce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5854:x1877969766189952:12345-0@lo:104: Request processed in 81us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971597.889318:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971597.889364:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000071f10cc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1877969766189952:0@lo:104: 00010000:00010000:0.0:1790971597.889384:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.889739:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971597.889745:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.889752:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000099b3fd6f already unused, calling callback (0000000069cb8483) 10000000:00010000:1.0:1790971597.889755:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.889816:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971597.889822:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971597.889827:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790971597.889864:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.889870:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971597.889896:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.889902:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 0000000099b3fd6f/0xbd3388eaa6f492ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.889919:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971597.889921:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971597.889922:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971597.890258:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000212597e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766190080:0@lo:103: 00000100:00100000:0.0:1790971597.890307:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971597.890906:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190080 00000100:00100000:1.0:1790971597.890921:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190080 00010000:00010000:1.0:1790971597.890945:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971597.890981:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790971597.890989:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000486d530f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:3303:x1877969766190080:12345-0@lo:103: 00010000:00010000:1.0:1790971597.891004:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971597.891008:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891019:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891035:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077d06edb/0xbd3388eaa6f492d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f492ce expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891053:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891061:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790971597.891077:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002345594s 00010000:00010000:1.0:1790971597.891082:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891088:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891095:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891109:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891114:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055beb1f8 already unused, calling callback (00000000ed3e1777) 00010000:00010000:1.0:1790971597.891118:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891125:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891140:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891150:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971597.891201:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000486d530f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3303:x1877969766190080:12345-0@lo:103: Request processed in 213us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.891208:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790971597.891248:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000212597e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766190080:0@lo:103: 00010000:00010000:1.0:1790971597.891270:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891278:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971597.891283:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000055beb1f8/0xbd3388eaa6f49306 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971597.911908:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004269d86d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5820:x1877969766189824:12345-0@lo:253: Request processed in 77907us (78482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971597.911942:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790971597.912071:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082e7e206 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:5820:1877969766189824:0@lo:253: 10000000:01000000:2.0:1790971597.912090:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790971597.912093:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790971597.912095:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971597.912096:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971597.912097:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971597.912099:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971597.912101:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971597.912102:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971597.912104:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971597.912106:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971597.912107:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971597.912109:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971597.912111:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790971597.912129:0:5820:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790971597.924689:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1790971597.927081:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790971597.927529:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790971597.927740:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790971597.927919:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790971597.928085:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790971597.928198:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790971597.936273:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790971597.936839:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790971597.937314:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790971597.938980:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790971597.939258:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790971597.939439:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1790971598.031241:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1790971598.093450:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1790971598.093464:0:5872:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1790971598.093497:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790971598.095215:0:5873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790971598.109066:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790971598.109410:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790971598.109855:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790971598.109865:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790971598.109999:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790971598.110984:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790971598.114195:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790971598.115574:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790971598.115844:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790971598.116029:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1790971598.122395:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790971598.122750:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790971598.122890:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790971598.123043:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790971598.123416:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790971598.123868:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790971598.124018:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790971598.124198:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790971598.124359:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790971598.124622:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790971598.124766:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790971598.124943:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790971598.125107:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790971598.125285:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790971598.125417:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790971598.125811:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790971598.126206:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790971598.126367:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790971598.126674:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790971598.126827:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790971598.126951:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790971598.127698:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790971598.127866:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1790971598.128019:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1790971598.128302:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1790971598.128609:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1790971598.128750:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1790971598.128912:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1790971598.129045:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1790971598.131773:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790971598.131995:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790971598.133733:0:5820:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790971598.133987:0:5820:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1790971598.166409:0:5873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790971598.237353:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790971598.237396:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa77fc1c73988 00100000:10000000:1.0:1790971598.237415:0:5820:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790971598.237702:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790971598.237718:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790971598.241610:0:5820:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790971598.241641:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1790971598.243303:0:5873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790971598.243373:0:5873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790971598.243377:0:5873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1790971598.950040:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971599.974368:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971601.008746:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971602.024887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971603.044731:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790971603.229466:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1790971603.304397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790971603.304416:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790971603.304419:0:8:0:(import.c:65:import_set_state_nolock()) 0000000055125b38 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790971603.304437:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000055125b38 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1790971603.304459:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c632c755 x1877969766190336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790971603.305921:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971603.305942:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082e7e206 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766190208:0@lo:400: 00000100:00100000:3.0:1790971603.306012:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971603.306081:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c632c755 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766190336:0@lo:38: 00000100:00100000:3.0:1790971603.306112:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971603.306168:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190336 00000100:00100000:3.0:1790971603.306175:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190336 00000100:00100000:3.0:1790971603.306208:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971603.306215:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f7f8fb6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877969766190336:12345-0@lo:38: 00010000:00080000:3.0:1790971603.306239:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000100:00100000:2.0:1790971603.306307:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190208 00000100:00100000:2.0:1790971603.306312:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190208 00000100:00100000:2.0:1790971603.306348:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790971603.306354:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cb272d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:3305:x1877969766190208:12345-0@lo:400: 00000100:00100000:2.0:1790971603.306416:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cb272d73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:3305:x1877969766190208:12345-0@lo:400: Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971603.306423:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:3.0:1790971603.306878:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbd3388eaa6f4930d 00000004:00100000:3.0:1790971603.306922:0:5840:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790971603.307032:0:5840:0:(import.c:65:import_set_state_nolock()) 000000006a54b796 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790971603.307088:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f7f8fb6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877969766190336:12345-0@lo:38: Request processed in 872us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971603.307095:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971603.307138:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082e7e206 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766190208:0@lo:400: 00010000:00080000:2.0:1790971603.307228:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c632c755 x1877969766190336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790971613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790971603.307264:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790971603.307272:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790971603.307277:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790971603.307279:0:3301:0:(import.c:65:import_set_state_nolock()) 0000000055125b38 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790971603.307284:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c632c755 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766190336:0@lo:38: 00010000:00010000:3.0:1790971604.069746:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971605.092691:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790971605.860609:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790971605.860619:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd4b52bc800 from 3 10000000:01000000:2.0:1790971605.860625:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790971605.860676:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000055beb1f8/0xbd3388eaa6f49314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971605.860688:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000055beb1f8/0xbd3388eaa6f49314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971605.860711:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000055beb1f8/0xbd3388eaa6f49314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971605.860738:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c632c755 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766190464:0@lo:101: 00000100:00100000:2.0:1790971605.860840:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971605.861032:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000763b1be8 going to sleep for 11 seconds 00000100:00100000:0.0:1790971605.862303:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190464 00000100:00100000:0.0:1790971605.862318:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190464 00000100:00100000:0.0:1790971605.862676:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790971605.862685:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f3acc2f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5836:x1877969766190464:12345-0@lo:101: 00010000:00010000:0.0:1790971605.862702:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971605.862721:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b085269e/0xbd3388eaa6f4931b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49314 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971605.862746:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b085269e/0xbd3388eaa6f4931b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971605.862756:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b085269e/0xbd3388eaa6f4931b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971605.862765:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b085269e, rc 0) 00000100:00100000:0.0:1790971605.862836:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f3acc2f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766190464:12345-0@lo:101: Request processed in 153us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971605.862920:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790971605.863321:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c632c755 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766190464:0@lo:101: 00010000:00010000:3.0:1790971605.863339:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000055beb1f8/0xbd3388eaa6f49314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971605.863349:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000055beb1f8/0xbd3388eaa6f49314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971605.863437:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3e177d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766190592:0@lo:256: 00000100:00100000:3.0:1790971605.863505:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971605.863540:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bad07de going to sleep for 11 seconds 00000100:00100000:2.0:1790971605.863911:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190592 00000100:00100000:2.0:1790971605.863919:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190592 00000100:00100000:2.0:1790971605.863965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790971605.863973:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000018ae8c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766190592:12345-0@lo:256: 20000000:01000000:2.0:1790971605.863991:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790971605.864009:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790971605.864012:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790971605.864111:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000018ae8c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766190592:12345-0@lo:256: Request processed in 138us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971605.864120:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3e177d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766190592:0@lo:256: 00000100:00100000:2.0:1790971605.864129:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:3.0:1790971605.864176:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790971605.864182:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000055beb1f8/0xbd3388eaa6f49314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971605.864191:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000055beb1f8/0xbd3388eaa6f49314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971606.116617:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971607.146769:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971608.164808:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790971608.366752:0:6318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1d1a29e0 20000000:00000080:3.0:1790971608.366769:0:6318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cd4be2fac00 uarg=0000000000000000 20000000:01000000:3.0:1790971608.366804:0:6318:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790971608.366811:0:6318:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790971608.366816:0:6318:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790971608.367634:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1790971608.367648:0:6318:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1790971608.374441:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790971608.376158:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790971608.376238:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1790971608.376293:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1790971608.376314:0:6318:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790971608.376887:0:6318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971608.376908:0:6318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971608.376916:0:6318:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971608.376956:0:6318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971608.377542:0:6318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 11 pid: 5831 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971608.377559:0:6318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3e177d9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1877969766190720:0@lo:104: 00000100:00100000:3.0:1790971608.377633:0:6318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971608.377738:0:6318:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c48ac97 going to sleep for 11 seconds 00000100:00100000:2.0:1790971608.377823:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190720 00000100:00100000:2.0:1790971608.377831:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190720 00000100:00100000:2.0:1790971608.377886:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971608.377895:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d6b0e024 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:6318:x1877969766190720:12345-0@lo:104: 00010000:00010000:2.0:1790971608.377907:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971608.377970:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790971608.377975:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d6b0e024 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:6318:x1877969766190720:12345-0@lo:104: Request processed in 83us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971608.377982:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790971608.378030:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971608.378036:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378043:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000579a06f2 already unused, calling callback (0000000069cb8483) 10000000:00010000:1.0:1790971608.378047:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378055:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971608.378061:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971608.378066:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790971608.378102:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378126:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971608.378146:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378153:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 00000000579a06f2/0xbd3388eaa6f492dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492e3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378182:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971608.378184:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971608.378186:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971608.378198:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000212597e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766190848:0@lo:103: 00000100:00100000:1.0:1790971608.378231:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971608.378264:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190848 00000100:00100000:1.0:1790971608.378268:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190848 00010000:00010000:1.0:1790971608.378287:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 12 pid: 5831 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971608.378308:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971608.378314:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000538ba6b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3305:x1877969766190848:12345-0@lo:103: 00010000:00010000:1.0:1790971608.378336:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971608.378341:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 12 pid: 5831 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378350:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 12 pid: 5831 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378365:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378393:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378407:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378413:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378420:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378425:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378430:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000056805646 already unused, calling callback (00000000ed3e1777) 00010000:00010000:1.0:1790971608.378434:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378440:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378448:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971608.378458:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971608.378512:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000538ba6b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3305:x1877969766190848:12345-0@lo:103: Request processed in 198us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971608.378518:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971608.378552:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000212597e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766190848:0@lo:103: 00010000:00010000:0.0:1790971608.384290:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c50508a/0xbd3388eaa6f492e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f492dc expref: 11 pid: 5831 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971608.384349:0:6318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3e177d9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1877969766190720:0@lo:104: 00010000:00010000:0.0:1790971608.384387:0:6318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971608.384397:0:6318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971608.384403:0:6318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971608.384409:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000056805646/0xbd3388eaa6f49322 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971608.420783:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018a6f28c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766190976:0@lo:400: 00000100:00100000:0.0:1790971608.420855:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971608.423558:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766190976 00000100:00100000:0.0:1790971608.423574:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766190976 00000100:00100000:0.0:1790971608.423634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971608.423642:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e4591c53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766190976:12345-0@lo:400: 00000100:00100000:0.0:1790971608.424621:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e4591c53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766190976:12345-0@lo:400: Request processed in 976us (3762us total) trans 0 rc 0/0 00010000:00080000:2.0:1790971608.424705:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000018a6f28c x1877969766190976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971608.424720:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018a6f28c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766190976:0@lo:400: 00000100:00100000:0.0:1790971608.435906:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790971609.188798:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971610.212733:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971611.236792:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971612.261649:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790971613.035664:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790971613.035671:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4b52bc800 from 1 10000000:01000000:3.0:1790971613.035676:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790971613.035723:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000007f77f4f3/0xbd3388eaa6f49329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971613.035734:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000007f77f4f3/0xbd3388eaa6f49329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971613.035758:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000007f77f4f3/0xbd3388eaa6f49329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971613.035780:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b0ecc77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766191104:0@lo:101: 00000100:00100000:3.0:1790971613.035851:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971613.037141:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c7cb82e going to sleep for 11 seconds 00000100:00100000:0.0:1790971613.045284:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766191104 00000100:00100000:0.0:1790971613.045299:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766191104 00000100:00100000:0.0:1790971613.046588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790971613.046599:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003bdb2c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+11:5836:x1877969766191104:12345-0@lo:101: 00010000:00010000:0.0:1790971613.046632:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971613.046661:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0705ccf/0xbd3388eaa6f49330 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49329 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971613.046687:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0705ccf/0xbd3388eaa6f49330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971613.046697:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0705ccf/0xbd3388eaa6f49330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971613.046705:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0705ccf, rc 0) 00000100:00100000:0.0:1790971613.046770:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003bdb2c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766191104:12345-0@lo:101: Request processed in 174us (10920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971613.046776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790971613.046812:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b0ecc77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766191104:0@lo:101: 00010000:00010000:0.0:1790971613.046826:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000007f77f4f3/0xbd3388eaa6f49329 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971613.046834:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000007f77f4f3/0xbd3388eaa6f49329 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971613.046893:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000608abe62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766191232:0@lo:501: 00000100:00100000:0.0:1790971613.046924:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971613.048074:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3138138 going to sleep for 11 seconds 00000100:00100000:0.0:1790971613.048102:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766191232 00000100:00100000:0.0:1790971613.048108:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766191232 00000100:00100000:0.0:1790971613.048144:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790971613.049393:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000354b4e05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766191232:12345-0@lo:501: 00000100:00100000:0.0:1790971613.052249:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000354b4e05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766191232:12345-0@lo:501: Request processed in 2856us (5317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971613.052263:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790971613.052311:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000608abe62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766191232:0@lo:501: 00000100:00100000:0.0:1790971613.052373:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000608abe62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766191360:0@lo:503: 00000100:00100000:0.0:1790971613.052434:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971613.052463:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3138138 going to sleep for 11 seconds 00000100:00100000:0.0:1790971613.052496:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766191360 00000100:00100000:0.0:1790971613.052502:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766191360 00000100:00100000:0.0:1790971613.052537:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790971613.052544:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000060b81795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766191360:12345-0@lo:503: 00000100:00100000:0.0:1790971613.052793:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000060b81795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766191360:12345-0@lo:503: Request processed in 249us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971613.052800:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790971613.052835:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000608abe62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766191360:0@lo:503: 00000100:00100000:0.0:1790971613.053020:0:6614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000608abe62 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6614:1877969766191488:0@lo:502: 00000100:00100000:0.0:1790971613.053063:0:6614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971613.053080:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766191488 00000100:00100000:0.0:1790971613.053084:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766191488 00000100:00100000:0.0:1790971613.053102:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790971613.053107:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000916b0e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6614:x1877969766191488:12345-0@lo:502: 00000100:00100000:0.0:1790971613.053232:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000916b0e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6614:x1877969766191488:12345-0@lo:502: Request processed in 125us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971613.053239:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790971613.053267:0:6614:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063dd1e7f going to sleep for 11 seconds 00000100:00100000:0.0:1790971613.053284:0:6614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000608abe62 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6614:1877969766191488:0@lo:502: 00000020:01000000:0.0:1790971613.053303:0:6614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790971613.053311:0:6614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971613.053314:0:6614:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790971613.053320:0:6614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4b52bc800 00000020:00000080:0.0:1790971613.053322:0:6614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790971613.053367:0:6614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6614:1877969766191616:0@lo:502: 00000100:00100000:0.0:1790971613.053400:0:6614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971613.053418:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766191616 00000100:00100000:0.0:1790971613.053421:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766191616 00000100:00100000:0.0:1790971613.053442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790971613.053448:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6614:x1877969766191616:12345-0@lo:502: 00000100:00100000:0.0:1790971613.053570:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6614:x1877969766191616:12345-0@lo:502: Request processed in 121us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971613.053577:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790971613.053605:0:6614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495931240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971613.053616:0:6614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6614:1877969766191616:0@lo:502: 00000020:01000000:0.0:1790971613.053633:0:6614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971613.053637:0:6614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971613.053639:0:6614:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790971613.053642:0:6614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1790971613.053689:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790971613.053702:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971613.053712:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971613.053723:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971613.285969:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971613.540805:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971613.540829:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766191744:0@lo:400: 00000100:00100000:3.0:1790971613.540898:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971613.541109:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766191872:0@lo:400: 00000100:00100000:0.0:1790971613.541144:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971613.541679:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766191744 00000100:00100000:0.0:1790971613.541688:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766191744 00000100:00100000:0.0:1790971613.541736:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790971613.541745:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3302:x1877969766191744:12345-0@lo:400: 00000100:00100000:0.0:1790971613.541810:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3302:x1877969766191744:12345-0@lo:400: Request processed in 64us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971613.541817:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790971613.541889:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766191744:0@lo:400: 00000100:00100000:3.0:1790971613.544973:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766191872 00000100:00100000:3.0:1790971613.544987:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766191872 00000100:00100000:3.0:1790971613.545034:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971613.545044:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766191872:12345-0@lo:400: 00000100:00100000:3.0:1790971613.545126:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766191872:12345-0@lo:400: Request processed in 85us (3981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971613.545134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790971613.545575:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cd4883f0a80 x1877969766191872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971613.545591:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766191872:0@lo:400: 00010000:00010000:0.0:1790971614.308966:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790971614.790081:0:6686:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790971614.790085:0:6686:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790971614.790220:0:6686:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cd4be529000 00000020:01000004:2.0:1790971614.790236:0:6686:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790971614.790247:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790971614.790270:0:6686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cd4be2a4d40) 00000020:00000080:2.0:1790971614.790286:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790971614.829839:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790971614.830142:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790971614.865133:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790971614.878882:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790971614.878933:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790971614.878991:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790971614.879016:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790971614.879362:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790971614.879371:0:6686:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790971614.879381:0:6686:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd3388eaa6f4933e 00000020:01000004:3.0:1790971614.879389:0:6686:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790971614.879408:0:6686:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790971614.879412:0:6686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790971614.879417:0:6686:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790971614.879421:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790971614.879431:0:6686:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cd488248000) 00000020:00000080:3.0:1790971614.879440:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1790971614.884155:0:6686:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971614.884414:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790971614.884421:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790971614.885666:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790971614.885675:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790971614.886221:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790971614.886228:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790971614.888004:0:6686:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971614.888410:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790971614.888426:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790971614.889800:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790971614.889809:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790971614.936237:0:6686:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971614.936687:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790971614.936694:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790971614.940192:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790971614.940205:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790971614.950262:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790971614.950278:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790971614.953410:0:6686:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971614.953712:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790971614.953718:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790971614.954332:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790971614.954339:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1790971615.020448:0:6686:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971615.020683:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1790971615.020689:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790971615.033372:0:6686:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790971615.033395:0:6686:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790971615.034583:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790971615.034608:0:6686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790971615.034614:0:6686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790971615.067826:0:6686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790971615.067864:0:6686:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790971615.067870:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790971615.067872:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971615.067873:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971615.067874:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971615.067875:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971615.067876:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971615.067877:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971615.067879:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971615.067880:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971615.067881:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971615.067883:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790971615.067887:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790971615.067889:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790971615.067890:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971615.067891:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971615.067892:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971615.067893:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971615.067894:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971615.067894:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971615.067895:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971615.067896:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971615.067897:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971615.067898:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790971615.068237:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790971615.068256:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766192000:0@lo:253: 00000100:00100000:2.0:1790971615.068340:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971615.068450:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495931780 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.068558:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192000 00000100:00100000:0.0:1790971615.068565:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192000 00000100:00100000:0.0:1790971615.068645:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790971615.068654:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766192000:12345-0@lo:253: 20000000:01000000:0.0:1790971615.068753:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790971615.068758:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1790971615.068763:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1790971615.068775:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1790971615.070050:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790971615.070292:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790971615.070307:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1790971615.070363:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1790971615.070371:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1790971615.070406:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1790971615.070459:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1790971615.071061:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1790971615.071084:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1790971615.071086:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1790971615.071124:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1790971615.071133:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790971615.071186:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1790971615.071195:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1790971615.071248:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1790971615.071259:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790971615.071295:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1790971615.071364:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1790971615.072436:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1790971615.072459:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1790971615.072461:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:1.0:1790971615.072803:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1790971615.072814:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790971615.072846:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1790971615.072852:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:1.0:1790971615.073007:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1790971615.073019:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790971615.073057:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1790971615.073098:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1790971615.073118:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790971615.073122:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790971615.073126:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790971615.073139:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790971615.073142:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790971615.073179:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790971615.073182:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790971615.075379:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1790971615.075895:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1790971615.076028:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1790971615.076111:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1790971615.076125:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790971615.076128:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790971615.076814:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790971615.076883:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790971615.077023:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1790971615.077284:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1790971615.077334:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1790971615.077394:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1790971615.077408:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790971615.077412:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790971615.078206:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1790971615.078259:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1790971615.078311:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1790971615.078800:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1790971615.078843:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1790971615.078877:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1790971615.078892:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1790971615.078894:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1790971615.078902:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790971615.078992:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079011:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002c400/0xbd3388eaa6f49265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079019:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494881c00/0xbd3388eaa6f49281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079026:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494880200/0xbd3388eaa6f492f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079034:0:5831:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079072:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494880200/0xbd3388eaa6f492f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079088:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd494880200/0xbd3388eaa6f492f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 12 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.079104:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1877969766192128:0@lo:104: 00000100:00100000:1.0:1790971615.079166:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790971615.079268:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494881c00/0xbd3388eaa6f49281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079278:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd494881c00/0xbd3388eaa6f49281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 12 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.079287:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1877969766192256:0@lo:104: 00000100:00100000:1.0:1790971615.079311:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790971615.079456:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002c400/0xbd3388eaa6f49265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.079465:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4a002c400/0xbd3388eaa6f49265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 12 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.079495:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1877969766192384:0@lo:104: 00000100:00100000:1.0:1790971615.079519:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971615.079777:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192128 00000100:00100000:3.0:1790971615.079786:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192128 00000100:00100000:3.0:1790971615.079827:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192256 00000100:00100000:3.0:1790971615.079829:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192256 00000100:00100000:3.0:1790971615.079842:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790971615.079851:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+4:5831:x1877969766192128:12345-0@lo:104: 00010000:00010000:3.0:1790971615.079866:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971615.079963:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790971615.079970:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+4:5831:x1877969766192128:12345-0@lo:104: Request processed in 120us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971615.079978:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790971615.079998:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790971615.080005:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495ace300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5831:x1877969766192256:12345-0@lo:104: 00010000:00010000:3.0:1790971615.080013:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.080084:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790971615.080106:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1877969766192128:0@lo:104: 00000100:00100000:1.0:1790971615.080115:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1877969766192256:0@lo:104: 00010000:00010000:0.0:1790971615.080212:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790971615.080220:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080227:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd400 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971615.080232:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080240:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971615.080258:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971615.080264:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971615.080304:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080311:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971615.080342:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080349:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f492ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f492f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080364:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971615.080367:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080373:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934200 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971615.080376:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080382:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971615.080388:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971615.080393:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971615.080414:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080419:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971615.080432:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080438:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494934200/0xbd3388eaa6f4927a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49281 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080448:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.080450:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.080452:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971615.080464:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766192512:0@lo:103: 00000100:00100000:0.0:1790971615.080542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.080576:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766192640:0@lo:103: 00000100:00100000:0.0:1790971615.080597:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.080774:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192512 00000100:00100000:0.0:1790971615.080779:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192512 00010000:00010000:0.0:1790971615.080802:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494880200/0xbd3388eaa6f492f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 13 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.080825:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192640 00000100:00100000:0.0:1790971615.080827:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192640 00010000:00010000:0.0:1790971615.080837:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494881c00/0xbd3388eaa6f49281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 14 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.080848:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971615.080854:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3305:x1877969766192512:12345-0@lo:103: 00010000:00010000:0.0:1790971615.080866:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971615.080877:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494880200/0xbd3388eaa6f492f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080887:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494880200/0xbd3388eaa6f492f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080902:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494880200/0xbd3388eaa6f492f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f492ea expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.080926:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971615.080957:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:3305:x1877969766192512:12345-0@lo:103: Request processed in 103us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.080964:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971615.080979:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971615.080985:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3302:x1877969766192640:12345-0@lo:103: 00010000:00010000:0.0:1790971615.080993:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971615.080998:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494881c00/0xbd3388eaa6f49281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 12 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081006:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494881c00/0xbd3388eaa6f49281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 12 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494881c00/0xbd3388eaa6f49281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4927a expref: 12 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081026:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971615.081051:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:3302:x1877969766192640:12345-0@lo:103: Request processed in 66us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.081057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971615.081087:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766192640:0@lo:103: 00000100:00100000:0.0:1790971615.081118:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766192512:0@lo:103: 00010000:00010000:3.0:1790971615.081388:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1790971615.081398:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495ace300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5831:x1877969766192256:12345-0@lo:104: Request processed in 1392us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971615.081405:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790971615.081422:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192384 00000100:00100000:3.0:1790971615.081427:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192384 00000100:00100000:3.0:1790971615.081450:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790971615.081457:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5831:x1877969766192384:12345-0@lo:104: 00010000:00010000:3.0:1790971615.081465:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971615.081585:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790971615.081590:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5831:x1877969766192384:12345-0@lo:104: Request processed in 135us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971615.081597:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790971615.081681:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971615.081687:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081695:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494880e00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971615.081699:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081707:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971615.081713:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971615.081718:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971615.081743:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081750:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971615.081763:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081770:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494880e00/0xbd3388eaa6f4925e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49265 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.081786:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.081787:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.081789:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971615.081801:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766192768:0@lo:103: 00000100:00100000:0.0:1790971615.081839:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790971615.081884:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971615.081891:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192768 00000100:00100000:0.0:1790971615.081894:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192768 00010000:00010000:0.0:1790971615.082027:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002c400/0xbd3388eaa6f49265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 11 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.082049:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790971615.082056:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:3303:x1877969766192768:12345-0@lo:103: 00010000:00010000:0.0:1790971615.082065:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971615.082069:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002c400/0xbd3388eaa6f49265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 11 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082078:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002c400/0xbd3388eaa6f49265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 11 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082094:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082102:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082116:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082124:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082131:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082148:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082153:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42c00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971615.082157:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082165:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082174:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.082184:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971615.082215:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:3303:x1877969766192768:12345-0@lo:103: Request processed in 159us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.082222:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790971615.082255:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766192768:0@lo:103: 00010000:00010000:1.0:1790971615.082458:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002c400/0xbd3388eaa6f49265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4925e expref: 10 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.082622:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1877969766192384:0@lo:104: 00010000:00010000:1.0:1790971615.082646:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.082655:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.082662:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.082736:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4934c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790971615.082750:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790971615.179248:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+9:6686:x1877969766192000:12345-0@lo:253: Request processed in 110580us (110893us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.179255:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766192000:0@lo:253: 00000100:00100000:2.0:1790971615.179268:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 10000000:01000000:0.0:1790971615.179283:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790971615.179287:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790971615.179290:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790971615.179292:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790971615.179293:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1790971615.179295:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790971615.179297:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790971615.179299:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790971615.179301:0:6686:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790971615.179303:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790971615.179305:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790971615.179351:0:6686:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cd4be529000 from lustre-OST0000 10000000:01000000:0.0:1790971615.179375:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790971615.179379:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790971615.179385:0:6686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cd48794cd40 local copy 10000000:01000000:0.0:1790971615.179389:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790971615.179423:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.179434:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.179444:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.179462:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766192896:0@lo:101: 00000100:00100000:0.0:1790971615.179531:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.179576:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093240 going to sleep for 11 seconds 00000100:00100000:1.0:1790971615.180193:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766192896 00000100:00100000:1.0:1790971615.180202:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766192896 00000100:00100000:1.0:1790971615.180259:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790971615.180268:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+9:6686:x1877969766192896:12345-0@lo:101: 00010000:00010000:1.0:1790971615.180289:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971615.180304:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4935a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49353 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.180338:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49353 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.180348:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49353 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.180357:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42c00, rc 0) 00000100:00100000:1.0:1790971615.180409:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+10:6686:x1877969766192896:12345-0@lo:101: Request processed in 142us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971615.180415:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790971615.180560:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766192896:0@lo:101: 00010000:00010000:0.0:1790971615.180575:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.180585:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.180692:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193024:0@lo:501: 00000100:00100000:0.0:1790971615.180723:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.180754:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971615.181187:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193024 00000100:00100000:2.0:1790971615.181194:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193024 00000100:00100000:2.0:1790971615.181244:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790971615.181252:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+10:6686:x1877969766193024:12345-0@lo:501: 00000100:00100000:2.0:1790971615.181545:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+10:6686:x1877969766193024:12345-0@lo:501: Request processed in 293us (820us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790971615.181559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790971615.183550:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193024:0@lo:501: 10000000:01000000:1.0:1790971615.183581:0:6686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790971615.183635:0:6686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790971615.183644:0:6686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.183655:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.183664:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.183681:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790971615.183717:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cd4be529000 10000000:01000000:1.0:1790971615.183722:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790971615.183729:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cd48794cd40 10000000:01000000:1.0:1790971615.183731:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790971615.183735:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cd48794cd40 from 1 10000000:01000000:1.0:1790971615.183738:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790971615.183768:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.183777:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.183787:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.183804:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193152:0@lo:101: 00000100:00100000:1.0:1790971615.183857:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971615.183899:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c000 going to sleep for 11 seconds 00010000:00010000:0.0:1790971615.184086:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790971615.184114:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193152 00000100:00100000:2.0:1790971615.184123:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193152 00010000:00010000:0.0:1790971615.184166:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971615.184177:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1790971615.184188:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd400 already unused, calling callback (ffffffffc1c89c20) 00000100:00100000:2.0:1790971615.184189:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+10:6686:x1877969766193152:12345-0@lo:101: 10000000:00010000:0.0:1790971615.184195:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971615.184207:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971615.184207:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971615.184215:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971615.184223:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790971615.184236:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494934e00/0xbd3388eaa6f49368 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49361 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.184254:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.184261:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971615.184264:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494934e00/0xbd3388eaa6f49368 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49361 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971615.184276:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494934e00/0xbd3388eaa6f49368 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49361 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971615.184286:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934e00, rc 0) 00000100:00100000:2.0:1790971615.184341:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193152:12345-0@lo:101: Request processed in 154us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971615.184348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1790971615.184567:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.184577:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f49353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd3388eaa6f4935a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.184594:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.184596:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.184597:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971615.184645:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766193280:0@lo:103: 00000100:00100000:3.0:1790971615.184684:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971615.184791:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193152:0@lo:101: 00010000:00010000:1.0:1790971615.184805:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49368 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.184813:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49368 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971615.184832:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:0.0:1790971615.186895:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193280 00000100:00100000:0.0:1790971615.186913:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193280 00010000:00010000:1.0:1790971615.187080:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49368 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.187104:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49368 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971615.187128:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790971615.187133:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000100:00100000:0.0:1790971615.187137:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:1.0:1790971615.187142:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790971615.187146:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00100000:0.0:1790971615.187150:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+11:3304:x1877969766193280:12345-0@lo:103: 00010000:00010000:0.0:1790971615.187164:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971615.187180:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.187185:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4935a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f49353 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.187195:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.187206:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.187218:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971615.187229:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193408:0@lo:101: 00000100:00100000:0.0:1790971615.187372:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+10:3304:x1877969766193280:12345-0@lo:103: Request processed in 225us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.187379:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971615.187535:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766193280:0@lo:103: 00000100:00100000:1.0:1790971615.191705:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.191772:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193408 00000100:00100000:0.0:1790971615.191783:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193408 00000100:00100000:0.0:1790971615.191831:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790971615.191840:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+10:6686:x1877969766193408:12345-0@lo:101: 00010000:00010000:0.0:1790971615.191856:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971615.191880:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4936f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.191909:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.191921:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.191930:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbde00, rc 0) 00000100:00100000:0.0:1790971615.191985:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193408:12345-0@lo:101: Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.191992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790971615.192041:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.192062:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193408:0@lo:101: 00010000:00010000:0.0:1790971615.192077:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.192100:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.192235:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193536:0@lo:501: 00000100:00100000:0.0:1790971615.192264:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.192287:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093540 going to sleep for 11 seconds 00000100:00100000:2.0:1790971615.193236:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193536 00000100:00100000:2.0:1790971615.193255:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193536 00000100:00100000:2.0:1790971615.193429:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790971615.193439:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193536:12345-0@lo:501: 00000100:00100000:2.0:1790971615.193725:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193536:12345-0@lo:501: Request processed in 287us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971615.193734:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790971615.193773:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193536:0@lo:501: 00000100:00100000:0.0:1790971615.193816:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193664:0@lo:503: 00000100:00100000:1.0:1790971615.201174:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971615.201270:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093540 going to sleep for 11 seconds 00000100:00100000:3.0:1790971615.205224:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193664 00000100:00100000:3.0:1790971615.205249:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193664 00000100:00100000:3.0:1790971615.208558:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790971615.208576:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193664:12345-0@lo:503: 00000100:00100000:3.0:1790971615.208830:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193664:12345-0@lo:503: Request processed in 260us (7663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971615.208838:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790971615.209257:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193664:0@lo:503: 00000040:00080000:2.0:1790971615.209627:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790971615.209714:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193792:0@lo:502: 00000100:00100000:2.0:1790971615.209769:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971615.209819:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.210113:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193792 00000100:00100000:0.0:1790971615.210121:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193792 00000100:00100000:0.0:1790971615.210169:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790971615.210177:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193792:12345-0@lo:502: 00000100:00100000:0.0:1790971615.211658:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193792:12345-0@lo:502: Request processed in 1475us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.211672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790971615.211811:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193792:0@lo:502: 00000040:00080000:2.0:1790971615.212416:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790971615.212515:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790971615.212554:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790971615.212600:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790971615.212635:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790971615.212667:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790971615.212704:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193920:0@lo:502: 00000100:00100000:2.0:1790971615.212758:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971615.212800:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971615.214913:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766193920 00000100:00100000:3.0:1790971615.214929:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766193920 00000100:00100000:3.0:1790971615.215042:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790971615.215054:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193920:12345-0@lo:502: 00000100:00100000:3.0:1790971615.217059:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766193920:12345-0@lo:502: Request processed in 2001us (4294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971615.217071:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790971615.219530:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766193920:0@lo:502: 00000040:00080000:2.0:1790971615.219719:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790971615.219734:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1790971615.223542:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790971615.223704:0:6705:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790971615.223712:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971615.223714:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790971615.223722:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790971615.223738:0:6705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cd4be2a0000) 00000020:00000080:2.0:1790971615.223759:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790971615.223765:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790971615.223847:0:6705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4be529000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790971615.223854:0:6705:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790971615.223860:0:6705:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd3388eaa6f49384 00010000:00010000:3.0:1790971615.229457:0:6705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1790971615.229779:0:6705:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1790971615.244820:0:6705:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790971615.245857:0:6705:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790971615.258408:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790971615.258980:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790971615.264025:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790971615.264037:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971615.264043:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971615.264046:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790971615.264050:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790971615.264054:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971615.264056:0:6705:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790971615.264060:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790971615.264063:0:6705:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790971615.264133:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971615.264137:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971615.264139:0:6705:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790971615.264148:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790971615.264450:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1790971615.264505:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790971615.264523:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971615.264535:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971615.264544:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4be529000 from 1 10000000:01000000:2.0:1790971615.264546:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971615.264583:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971615.264591:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971615.264614:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971615.264638:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194048:0@lo:101: 00000100:00100000:2.0:1790971615.264719:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971615.264764:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74900 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.265213:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194048 00000100:00100000:0.0:1790971615.265221:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194048 00000100:00100000:0.0:1790971615.265262:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790971615.265272:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:6686:x1877969766194048:12345-0@lo:101: 00010000:00010000:0.0:1790971615.265285:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971615.265300:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4938b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.265338:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.265349:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.265358:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd400, rc 0) 00000100:00100000:0.0:1790971615.265413:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194048:12345-0@lo:101: Request processed in 142us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.265420:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790971615.265516:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194048:0@lo:101: 00010000:00010000:3.0:1790971615.265532:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971615.265541:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971615.265640:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194176:0@lo:501: 00000100:00100000:3.0:1790971615.265666:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971615.265692:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4959e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.265744:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194176 00000100:00100000:0.0:1790971615.265749:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194176 00000100:00100000:0.0:1790971615.265778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790971615.265785:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194176:12345-0@lo:501: 00000100:00100000:0.0:1790971615.266659:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194176:12345-0@lo:501: Request processed in 870us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.266668:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790971615.266767:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194176:0@lo:501: 00000100:00100000:3.0:1790971615.266804:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194304:0@lo:503: 00000100:00100000:3.0:1790971615.266867:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971615.266897:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4959e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.267030:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194304 00000100:00100000:0.0:1790971615.267037:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194304 00000100:00100000:0.0:1790971615.267074:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790971615.267088:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194304:12345-0@lo:503: 00000100:00100000:0.0:1790971615.267567:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194304:12345-0@lo:503: Request processed in 478us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.267574:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790971615.272045:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194304:0@lo:503: 00000040:00080000:0.0:1790971615.272626:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790971615.272705:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194432:0@lo:502: 00000100:00100000:0.0:1790971615.272778:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.272814:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971615.273191:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194432 00000100:00100000:3.0:1790971615.273200:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194432 00000100:00100000:3.0:1790971615.273256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790971615.273266:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194432:12345-0@lo:502: 00000100:00100000:3.0:1790971615.273508:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194432:12345-0@lo:502: Request processed in 242us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971615.273517:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790971615.273553:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194432:0@lo:502: 00000040:00080000:2.0:1790971615.273838:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790971615.273894:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790971615.273929:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194560:0@lo:502: 00000100:00100000:2.0:1790971615.273972:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971615.274003:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971615.274076:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194560 00000100:00100000:3.0:1790971615.274081:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194560 00000100:00100000:3.0:1790971615.274113:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790971615.274121:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194560:12345-0@lo:502: 00000100:00100000:3.0:1790971615.274284:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194560:12345-0@lo:502: Request processed in 163us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971615.274291:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790971615.274367:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194560:0@lo:502: 00000040:00080000:1.0:1790971615.274449:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790971615.274459:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790971615.275238:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971615.275247:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971615.275256:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790971615.275265:0:6709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4be529000 00000020:00000080:2.0:1790971615.275267:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790971615.275372:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971615.275376:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971615.275378:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790971615.275381:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790971615.276118:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790971615.276147:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790971615.276215:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.276230:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971615.276304:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790971615.276308:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cd4be529000 10000000:01000000:1.0:1790971615.276312:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cd4be529000 10000000:01000000:1.0:1790971615.276325:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790971615.276331:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4be529000 from 1 10000000:01000000:1.0:1790971615.276334:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790971615.276373:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.276381:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.276392:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.276414:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194688:0@lo:101: 00000100:00100000:1.0:1790971615.276496:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971615.276536:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971615.276561:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194688 00000100:00100000:1.0:1790971615.276569:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194688 00000100:00100000:1.0:1790971615.276611:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790971615.276619:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766194688:12345-0@lo:101: 00010000:00010000:1.0:1790971615.276633:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971615.276644:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49399 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.276667:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.276689:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.276697:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42400, rc 0) 00000100:00100000:1.0:1790971615.276737:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766194688:12345-0@lo:101: Request processed in 117us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971615.276743:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790971615.276795:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194688:0@lo:101: 00010000:00010000:1.0:1790971615.276808:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971615.276817:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971615.276914:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194816:0@lo:501: 00000100:00100000:1.0:1790971615.276940:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971615.276957:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971615.277247:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194816 00000100:00100000:2.0:1790971615.277252:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194816 00000100:00100000:2.0:1790971615.277291:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790971615.277298:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766194816:12345-0@lo:501: 00000100:00100000:2.0:1790971615.277553:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766194816:12345-0@lo:501: Request processed in 255us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971615.277560:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790971615.277687:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194816:0@lo:501: 00000100:00100000:3.0:1790971615.277719:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194944:0@lo:503: 00000100:00100000:3.0:1790971615.277759:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971615.277791:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4959e6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971615.281501:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766194944 00000100:00100000:2.0:1790971615.281514:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766194944 00000100:00100000:2.0:1790971615.281570:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790971615.281579:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766194944:12345-0@lo:503: 00000100:00100000:2.0:1790971615.281855:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766194944:12345-0@lo:503: Request processed in 276us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971615.281863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790971615.282714:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766194944:0@lo:503: 00000040:00080000:2.0:1790971615.283358:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790971615.283436:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766195072:0@lo:502: 00000100:00100000:2.0:1790971615.283644:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971615.283718:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971615.283761:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195072 00000100:00100000:1.0:1790971615.283769:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195072 00000100:00100000:1.0:1790971615.283834:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790971615.283843:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766195072:12345-0@lo:502: 00000100:00100000:1.0:1790971615.285796:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766195072:12345-0@lo:502: Request processed in 1944us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971615.285810:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790971615.285899:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766195072:0@lo:502: 00000040:00080000:0.0:1790971615.286214:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790971615.286270:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790971615.286841:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790971615.286889:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790971615.286918:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790971615.286954:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790971615.286988:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790971615.287021:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790971615.287154:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790971615.287183:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790971615.287209:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790971615.287266:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790971615.287380:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790971615.287416:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790971615.287461:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790971615.287652:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790971615.287686:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790971615.287732:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790971615.287767:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790971615.287802:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790971615.287853:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790971615.287898:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790971615.287924:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790971615.287963:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790971615.287998:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790971615.288116:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790971615.288161:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790971615.288205:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1790971615.288252:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766195200:0@lo:502: 00000100:00100000:0.0:1790971615.288439:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971615.288670:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195200 00000100:00100000:1.0:1790971615.288679:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195200 00000100:00100000:1.0:1790971615.288762:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790971615.288771:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766195200:12345-0@lo:502: 00000100:00100000:1.0:1790971615.288980:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766195200:12345-0@lo:502: Request processed in 209us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971615.288988:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790971615.289102:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093600 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.289121:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766195200:0@lo:502: 00000040:00080000:0.0:1790971615.289191:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790971615.289202:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790971615.289760:0:6710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790971615.289776:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cd49fdd19c0) 00000020:00000080:0.0:1790971615.289795:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1790971615.289873:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4be529000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790971615.289877:0:6710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4be529000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790971615.289879:0:6710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4be529000 3 00010000:00080000:0.0:1790971615.289904:0:6710:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd385017800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1790971615.292783:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1790971615.293048:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790971615.293096:0:6710:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790971615.293107:0:6710:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbd3388eaa6f493ae 00000100:00080000:0.0:1790971615.293117:0:6710:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790971615.293128:0:6710:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cd385017800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1790971615.293171:0:6710:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4be2edf80 x1877969766195328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790971615.293199:0:6710:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790971615.293264:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971615.293282:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766195456:0@lo:400: 00000100:00100000:0.0:1790971615.293346:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.293392:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195456 00000100:00100000:0.0:1790971615.293399:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195456 00000100:00100000:0.0:1790971615.293438:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971615.293446:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766195456:12345-0@lo:400: 00000100:00100000:0.0:1790971615.293524:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766195456:12345-0@lo:400: Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.293531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790971615.293570:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cd4be2ef480 x1877969766195456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971615.293583:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766195456:0@lo:400: 00000100:00100000:3.0:1790971615.293918:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766195328:0@lo:38: 00000100:00100000:3.0:1790971615.293954:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790971615.294235:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1790971615.294518:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195328 00000100:00100000:0.0:1790971615.294523:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195328 00000100:00100000:0.0:1790971615.294547:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971615.294553:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1877969766195328:12345-0@lo:38: 00010000:00080000:0.0:1790971615.294574:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1790971615.294604:0:5838:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbd3388eaa6f493b5 00000004:00100000:0.0:1790971615.294620:0:5838:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790971615.294650:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8cd385016000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971615.294700:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877969766195328:12345-0@lo:38: Request processed in 146us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.294707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1790971615.294727:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790971615.294751:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790971615.294764:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.294782:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790971615.294826:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790971615.294829:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790971615.294830:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790971615.294831:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790971615.294832:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790971615.294833:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790971615.294835:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790971615.294837:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790971615.294838:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790971615.294839:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790971615.294841:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790971615.294845:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1790971615.294847:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790971615.294849:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790971615.294850:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790971615.294851:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790971615.294852:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790971615.294853:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790971615.294854:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790971615.294855:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790971615.294856:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790971615.294857:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790971615.294858:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790971615.294876:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790971615.294888:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766195584:0@lo:253: 00000100:00100000:0.0:1790971615.294923:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.294944:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd3810936c0 going to sleep for 11 seconds 00010000:00080000:1.0:1790971615.295088:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cd4be2edf80 x1877969766195328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790971625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971615.295098:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790971615.295104:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790971615.295110:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790971615.295114:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790971615.295116:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd385017800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790971615.295121:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766195328:0@lo:38: 00000100:00100000:1.0:1790971615.295141:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195584 00000100:00100000:1.0:1790971615.295144:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195584 00000100:00100000:1.0:1790971615.295175:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790971615.295181:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6686:x1877969766195584:12345-0@lo:253: 20000000:01000000:1.0:1790971615.295200:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790971615.295212:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790971615.320461:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790971615.320514:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790971615.320551:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790971615.320555:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790971615.320578:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.320611:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4931b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.320620:0:5854:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.320663:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4931b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.320678:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4931b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 13 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.320692:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ee300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1877969766195712:0@lo:104: 00000100:00100000:0.0:1790971615.320759:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.320805:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971615.320847:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195712 00000100:00100000:0.0:1790971615.320855:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195712 00000100:00100000:0.0:1790971615.320900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971615.320910:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5854:x1877969766195712:12345-0@lo:104: 00010000:00010000:0.0:1790971615.320923:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.320972:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790971615.320978:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5854:x1877969766195712:12345-0@lo:104: Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.320985:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790971615.321006:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971615.321011:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321025:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935a00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971615.321029:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321038:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971615.321045:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971615.321050:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971615.321078:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321084:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971615.321099:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321105:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f49314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4931b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321121:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.321123:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971615.321125:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971615.321145:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766195840:0@lo:103: 00000100:00100000:0.0:1790971615.321177:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971615.321214:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195840 00000100:00100000:0.0:1790971615.321219:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195840 00010000:00010000:0.0:1790971615.321235:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4931b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.321261:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971615.321267:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b5251850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3302:x1877969766195840:12345-0@lo:103: 00010000:00010000:0.0:1790971615.321636:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971615.321644:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4931b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321655:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4931b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321672:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321680:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790971615.321693:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002345594s 00010000:00010000:0.0:1790971615.321698:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321705:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321713:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321719:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321724:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971615.321728:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321741:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321751:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321760:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971615.321839:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b5251850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3302:x1877969766195840:12345-0@lo:103: Request processed in 570us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.321847:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790971615.321906:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4931b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49314 expref: 13 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971615.321917:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ee300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1877969766195712:0@lo:104: 00010000:00010000:0.0:1790971615.321931:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321939:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321945:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971615.321952:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f493bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971615.324293:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766195840:0@lo:103: 00000100:00100000:0.0:1790971615.327800:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:6686:x1877969766195584:12345-0@lo:253: Request processed in 32609us (32867us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971615.327816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790971615.327912:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:6686:1877969766195584:0@lo:253: 10000000:01000000:2.0:1790971615.327927:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790971615.327937:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790971615.327939:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971615.327940:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971615.327941:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971615.327942:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971615.327943:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971615.327944:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971615.327946:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971615.327947:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971615.327948:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971615.327950:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790971615.327965:0:6686:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1790971615.332960:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1790971615.333198:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790971615.333567:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790971615.333785:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790971615.333962:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790971615.334162:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790971615.334459:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790971615.335454:0:6686:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790971615.528105:0:6686:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790971615.528115:0:6686:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790971615.528155:0:6686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790971615.528232:0:6686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790971615.528248:0:6686:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790971615.528635:0:6686:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790971616.362714:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971617.380654:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971618.406241:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971619.431257:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971620.459340:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971620.708631:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971620.708657:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766195968:0@lo:400: 00000100:00100000:0.0:1790971620.708746:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971620.708798:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766196096:0@lo:400: 00000100:00100000:0.0:1790971620.708827:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971620.708846:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971620.708853:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766196224:0@lo:400: 00000100:00100000:0.0:1790971620.708879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971620.708911:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196096 00000100:00100000:0.0:1790971620.708919:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196096 00000100:00100000:0.0:1790971620.708956:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196224 00000100:00100000:0.0:1790971620.708959:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196224 00000100:00100000:0.0:1790971620.708983:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971620.708990:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766196096:12345-0@lo:400: 00000100:00100000:0.0:1790971620.709040:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766196096:12345-0@lo:400: Request processed in 50us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971620.709047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971620.709062:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790971620.709067:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766196224:12345-0@lo:400: 00000100:00100000:0.0:1790971620.709094:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766196224:12345-0@lo:400: Request processed in 27us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971620.709110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790971620.709148:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2ec700 x1877969766196224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971620.709161:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766196224:0@lo:400: 00010000:00080000:0.0:1790971620.709172:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2ef100 x1877969766196096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971620.709180:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766196096:0@lo:400: 00000100:00100000:1.0:1790971620.709466:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766195968 00000100:00100000:1.0:1790971620.709497:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766195968 00000100:00100000:1.0:1790971620.709527:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790971620.709534:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3302:x1877969766195968:12345-0@lo:400: 00000100:00100000:1.0:1790971620.709575:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3302:x1877969766195968:12345-0@lo:400: Request processed in 41us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971620.709581:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790971620.709669:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766195968:0@lo:400: 00000100:00080000:2.0:1790971620.709970:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790971621.477611:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790971621.733695:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790971621.733703:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4b52bc800 from 21 10000000:01000000:2.0:1790971621.733708:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790971621.733752:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971621.733764:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971621.733774:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971621.733798:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196352:0@lo:101: 00000100:00100000:2.0:1790971621.733861:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.733902:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a780 going to sleep for 11 seconds 00000100:00100000:0.0:1790971621.733946:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196352 00000100:00100000:0.0:1790971621.733953:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196352 00000100:00100000:0.0:1790971621.734002:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790971621.734012:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766196352:12345-0@lo:101: 00010000:00010000:0.0:1790971621.734029:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971621.734045:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f493c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.734073:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.734085:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.734094:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc000, rc 0) 00000100:00100000:0.0:1790971621.734133:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766196352:12345-0@lo:101: Request processed in 122us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.734140:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790971621.734238:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196352:0@lo:101: 00010000:00010000:2.0:1790971621.734252:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971621.734261:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971621.734327:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196480:0@lo:501: 00000100:00100000:2.0:1790971621.734351:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.734374:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a780 going to sleep for 11 seconds 00000100:00100000:0.0:1790971621.734499:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196480 00000100:00100000:0.0:1790971621.734504:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196480 00000100:00100000:0.0:1790971621.734532:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790971621.734539:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766196480:12345-0@lo:501: 00000100:00100000:0.0:1790971621.734795:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766196480:12345-0@lo:501: Request processed in 255us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.734802:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790971621.734940:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196480:0@lo:501: 00000100:00100000:2.0:1790971621.734967:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196608:0@lo:503: 00000100:00100000:2.0:1790971621.735004:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.735028:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a780 going to sleep for 11 seconds 00000100:00100000:0.0:1790971621.735134:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196608 00000100:00100000:0.0:1790971621.735139:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196608 00000100:00100000:0.0:1790971621.735166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790971621.735173:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766196608:12345-0@lo:503: 00000100:00100000:0.0:1790971621.735345:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766196608:12345-0@lo:503: Request processed in 172us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.735352:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790971621.735493:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196608:0@lo:503: 00000100:00100000:2.0:1790971621.736119:0:6998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6998:1877969766196736:0@lo:502: 00000100:00100000:2.0:1790971621.736166:0:6998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.736201:0:6998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971621.736253:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196736 00000100:00100000:0.0:1790971621.736258:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196736 00000100:00100000:0.0:1790971621.736301:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790971621.736309:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6998:x1877969766196736:12345-0@lo:502: 00000100:00100000:0.0:1790971621.736513:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6998:x1877969766196736:12345-0@lo:502: Request processed in 204us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.736521:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790971621.736752:0:6998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6998:1877969766196736:0@lo:502: 00000100:00100000:2.0:1790971621.736801:0:6998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6998:1877969766196864:0@lo:502: 00000100:00100000:2.0:1790971621.736835:0:6998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.736859:0:6998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.736928:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196864 00000100:00100000:3.0:1790971621.736933:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196864 00000100:00100000:3.0:1790971621.736994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790971621.737000:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6998:x1877969766196864:12345-0@lo:502: 00000100:00100000:3.0:1790971621.737146:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:6998:x1877969766196864:12345-0@lo:502: Request processed in 145us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971621.737154:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790971621.737211:0:6998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6998:1877969766196864:0@lo:502: 00000040:00080000:2.0:1790971621.737240:0:6998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790971621.739699:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790971621.739728:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790971621.739738:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971621.739750:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971621.739758:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790971621.739760:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd4b52bc800 from 4 10000000:01000000:1.0:1790971621.739763:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790971621.739799:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971621.739807:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971621.739817:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971621.739851:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196992:0@lo:101: 00000100:00100000:1.0:1790971621.739911:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971621.749128:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971621.749207:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766196992 00000100:00100000:0.0:1790971621.749217:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766196992 00000100:00100000:0.0:1790971621.751395:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790971621.751407:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766196992:12345-0@lo:101: 00010000:00010000:0.0:1790971621.751427:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971621.751448:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f493d1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.751504:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.751517:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.751526:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbce00, rc 0) 00000100:00100000:0.0:1790971621.751627:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766196992:12345-0@lo:101: Request processed in 220us (11714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.751633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790971621.753093:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766196992:0@lo:101: 00010000:00010000:1.0:1790971621.753118:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971621.753130:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971621.753198:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197120:0@lo:256: 00000100:00100000:1.0:1790971621.753263:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971621.753313:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c000 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.753439:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766197120 00000100:00100000:3.0:1790971621.753447:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766197120 00000100:00100000:3.0:1790971621.753514:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790971621.753522:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766197120:12345-0@lo:256: 20000000:01000000:3.0:1790971621.753551:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790971621.753578:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790971621.753582:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790971621.753662:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766197120:12345-0@lo:256: Request processed in 141us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971621.753670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790971621.753707:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197120:0@lo:256: 10000000:01000000:3.0:1790971621.753746:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790971621.753754:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971621.753763:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971621.753771:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790971621.753774:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790971621.753777:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790971621.753800:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971621.753807:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971621.753816:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971621.753829:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197248:0@lo:101: 00000100:00100000:3.0:1790971621.753854:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971621.753874:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.753890:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766197248 00000100:00100000:3.0:1790971621.753895:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766197248 00000100:00100000:3.0:1790971621.753916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790971621.753923:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766197248:12345-0@lo:101: 00010000:00010000:3.0:1790971621.753931:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971621.753941:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f493df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971621.753958:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971621.753967:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971621.753975:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00000100:00100000:3.0:1790971621.753999:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766197248:12345-0@lo:101: Request processed in 77us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971621.754005:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790971621.754029:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197248:0@lo:101: 00010000:00010000:3.0:1790971621.754038:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971621.754045:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971621.754083:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197376:0@lo:501: 00000100:00100000:3.0:1790971621.754103:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971621.754115:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.754125:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766197376 00000100:00100000:3.0:1790971621.754133:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766197376 00000100:00100000:3.0:1790971621.754149:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790971621.754154:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766197376:12345-0@lo:501: 00000100:00100000:3.0:1790971621.754541:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766197376:12345-0@lo:501: Request processed in 385us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971621.754549:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790971621.754640:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197376:0@lo:501: 00000100:00100000:3.0:1790971621.754666:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197504:0@lo:503: 00000100:00100000:3.0:1790971621.754701:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971621.754719:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.754730:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766197504 00000100:00100000:3.0:1790971621.754733:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766197504 00000100:00100000:3.0:1790971621.754750:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790971621.754755:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766197504:12345-0@lo:503: 00000100:00100000:3.0:1790971621.754947:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766197504:12345-0@lo:503: Request processed in 191us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971621.754954:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790971621.754991:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766197504:0@lo:503: 00000100:00100000:3.0:1790971621.755167:0:6999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6999:1877969766197632:0@lo:502: 00000100:00100000:3.0:1790971621.755199:0:6999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971621.755217:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766197632 00000100:00100000:3.0:1790971621.755220:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766197632 00000100:00100000:3.0:1790971621.755420:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790971621.755426:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:6999:x1877969766197632:12345-0@lo:502: 00000100:00100000:3.0:1790971621.755701:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:6999:x1877969766197632:12345-0@lo:502: Request processed in 274us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971621.755715:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790971621.755753:0:6999:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2000 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.755766:0:6999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6999:1877969766197632:0@lo:502: 00000020:01000000:3.0:1790971621.755788:0:6999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790971621.755795:0:6999:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790971621.755801:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971621.755804:0:6999:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790971621.755808:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790971621.755813:0:6999:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:3.0:1790971621.755834:0:6999:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790971621.755837:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790971621.755852:0:6999:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cd4882499c0) 00000020:00000080:3.0:1790971621.755870:0:6999:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1790971621.755876:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790971621.755952:0:6999:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790971621.755957:0:6999:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790971621.755963:0:6999:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f493f4 00010000:00080000:3.0:1790971621.755994:0:6999:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd387494800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1790971621.756215:0:6999:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1790971621.807097:0:6999:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790971621.807119:0:6999:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790971621.808040:0:6999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790971621.808226:0:6999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790971621.808288:0:6999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1790971621.808347:0:6999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1790971621.809946:0:7003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790971621.809952:0:7003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790971621.813543:0:6999:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790971621.813692:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790971621.813734:0:6999:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790971621.813755:0:6999:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f493fb 00000100:00080000:0.0:1790971621.813767:0:6999:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790971621.813778:0:6999:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cd387494800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1790971621.813818:0:6999:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4be2ee300 x1877969766197760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790971621.813848:0:6999:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1790971621.813924:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766197760:0@lo:8: 00000100:00100000:2.0:1790971621.813991:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.814055:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766197760 00000100:00100000:2.0:1790971621.814062:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766197760 00000100:00100000:2.0:1790971621.814093:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790971621.814099:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1877969766197760:12345-0@lo:8: 00010000:00080000:2.0:1790971621.814131:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1790971621.814157:0:6689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f49402 00002000:00100000:2.0:1790971621.814187:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cd384dec000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790971621.814191:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1790971621.814195:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790971621.814328:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1790971621.814363:0:6999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971621.814368:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971621.814370:0:6999:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790971621.814373:0:6999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790971621.814376:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971621.814377:0:6999:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790971621.814380:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790971621.814381:0:6999:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790971621.814403:0:6999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6999:1877969766197888:0@lo:502: 00000100:00100000:0.0:1790971621.814449:0:6999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1790971621.814454:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1790971621.814487:0:6999:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488a58780 going to sleep for 11 seconds 00000100:00080000:2.0:1790971621.814491:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cd384ded000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790971621.814537:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1877969766197760:12345-0@lo:8: Request processed in 436us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.814539:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766198016:0@lo:400: 00000100:00100000:2.0:1790971621.814544:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790971621.814577:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2ee300 x1877969766197760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790971631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971621.814586:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790971621.814592:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790971621.814599:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790971621.814603:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790971621.814605:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd387494800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790971621.814616:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790971621.814621:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766197760:0@lo:8: 00000004:00080000:2.0:1790971621.814644:0:7003:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790971621.814736:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766197888 00000100:00100000:1.0:1790971621.814741:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766197888 00000004:00080000:2.0:1790971621.814757:0:7003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200754286593ns, next at 0ns, rc = 0 00000100:00100000:1.0:1790971621.814769:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790971621.814776:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:6999:x1877969766197888:12345-0@lo:502: 00000100:00100000:0.0:1790971621.814945:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971621.814966:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971621.814973:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766198144:0@lo:400: 00000100:00100000:0.0:1790971621.814995:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971621.815019:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198016 00000100:00100000:0.0:1790971621.815023:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198016 00000100:00100000:0.0:1790971621.815044:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198144 00000100:00100000:0.0:1790971621.815046:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198144 00000100:00100000:0.0:1790971621.815060:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971621.815066:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766198016:12345-0@lo:400: 00000100:00100000:0.0:1790971621.815102:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766198016:12345-0@lo:400: Request processed in 35us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.815107:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971621.815118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971621.815126:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766198144:12345-0@lo:400: 00000100:00100000:0.0:1790971621.815156:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766198144:12345-0@lo:400: Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971621.815162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790971621.815189:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2ef800 x1877969766198144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971621.815200:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766198144:0@lo:400: 00010000:00080000:0.0:1790971621.815210:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2ec700 x1877969766198016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971621.819524:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766198016:0@lo:400: 00000100:00100000:1.0:1790971621.819878:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:6999:x1877969766197888:12345-0@lo:502: Request processed in 5099us (5425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971621.819889:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790971621.820378:0:6999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:6999:1877969766197888:0@lo:502: 00000020:01000000:2.0:1790971621.820410:0:6999:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971621.820417:0:6999:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971621.820419:0:6999:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790971621.820433:0:6999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1790971621.820534:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790971621.820551:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790971621.820571:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.820583:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971621.820593:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790971621.820595:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cd48794cd40 from 1 10000000:01000000:0.0:1790971621.820598:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790971621.820640:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.820648:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.820657:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971621.820673:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766198272:0@lo:101: 00000100:00100000:0.0:1790971621.820713:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971621.820753:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488a58300 going to sleep for 11 seconds 00000100:00100000:2.0:1790971621.820856:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198272 00000100:00100000:2.0:1790971621.820871:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198272 00000100:00100000:2.0:1790971621.820916:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790971621.820926:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766198272:12345-0@lo:101: 00010000:00010000:2.0:1790971621.820938:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971621.820950:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49409 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971621.820971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971621.820981:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971621.820989:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494935200, rc 0) 00000100:00100000:2.0:1790971621.821020:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766198272:12345-0@lo:101: Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971621.821036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790971621.821100:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766198272:0@lo:101: 00010000:00010000:0.0:1790971621.821112:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971621.821131:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971621.821176:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766198400:0@lo:501: 00000100:00100000:0.0:1790971621.821200:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971621.821217:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488a58300 going to sleep for 11 seconds 00000100:00100000:2.0:1790971621.821403:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198400 00000100:00100000:2.0:1790971621.821407:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198400 00000100:00100000:2.0:1790971621.821432:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790971621.821438:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766198400:12345-0@lo:501: 00000100:00100000:2.0:1790971621.821637:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766198400:12345-0@lo:501: Request processed in 198us (435us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790971621.821645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790971621.821675:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766198400:0@lo:501: 10000000:01000000:2.0:1790971621.821696:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790971621.821707:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971621.821714:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790971621.860656:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790971621.895774:0:7004:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790971621.895817:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766198656:0@lo:7: 00000100:00100000:3.0:1790971621.895894:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971621.895935:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd489cabd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.897016:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766198528:0@lo:13: 00000100:00100000:3.0:1790971621.897062:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971621.897118:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198656 00000100:00100000:3.0:1790971621.897126:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198656 00000100:00100000:3.0:1790971621.897182:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971621.897193:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7004:x1877969766198656:12345-0@lo:7: 00000100:00100000:1.0:1790971621.897219:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198528 00000100:00100000:1.0:1790971621.897226:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198528 00000100:00100000:1.0:1790971621.897260:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790971621.897278:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766198528:12345-0@lo:13: 00002000:00000024:1.0:1790971621.897304:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790971621.897450:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766198528:12345-0@lo:13: Request processed in 182us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971621.897464:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790971621.897533:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4883f3b80 x1877969766198528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790971621.897597:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971621.899319:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766198528:0@lo:13: 00002000:00080000:3.0:1790971621.918035:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790971621.918043:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790971621.918142:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7004:x1877969766198656:12345-0@lo:7: Request processed in 20947us (22243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971621.918154:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790971621.918605:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4883f3100 x1877969766198656/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790971637 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971621.918620:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766198656:0@lo:7: 00000004:00080000:2.0:1790971621.918633:0:7004:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790971621.918673:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766198784:0@lo:5: 00000100:00100000:2.0:1790971621.918716:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.918756:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.919342:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198784 00000100:00100000:3.0:1790971621.919349:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198784 00000100:00100000:3.0:1790971621.919409:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790971621.919418:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7004:x1877969766198784:12345-0@lo:5: 00002000:00080000:3.0:1790971621.919450:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790971621.919454:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790971621.920257:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7004:x1877969766198784:12345-0@lo:5: Request processed in 836us (1536us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790971621.920278:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790971621.920312:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bd8a0a80 x1877969766198784/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790971637 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971621.920330:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766198784:0@lo:5: 00000004:00080000:2.0:1790971621.920343:0:7004:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790971621.920384:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766198912:0@lo:700: 00000100:00100000:2.0:1790971621.920423:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971621.920458:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790971621.920675:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766198912 00000100:00100000:3.0:1790971621.920681:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766198912 00000100:00100000:3.0:1790971621.920723:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971621.920731:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7004:x1877969766198912:12345-0@lo:700: 00000100:00100000:3.0:1790971621.920765:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1877969766199040:0@lo:700: 00000100:00100000:3.0:1790971621.920808:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971621.920826:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd489cab840 going to sleep for 11 seconds 00000100:00100000:2.0:1790971621.920961:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199040 00000100:00100000:2.0:1790971621.920966:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199040 00000100:00100000:2.0:1790971621.921001:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790971621.921008:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1877969766199040:12345-0@lo:700: 40000000:02000000:2.0:1790971621.999688:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1790971622.009736:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1877969766199040:12345-0@lo:700: Request processed in 88720us (88919us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971622.009752:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790971622.009817:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4883f2d80 x1877969766199040/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790971637 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971622.009833:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1877969766199040:0@lo:700: 40000000:02000000:2.0:1790971622.009847:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1790971622.140902:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790971622.141230:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1790971622.143970:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7004:x1877969766198912:12345-0@lo:700: Request processed in 223231us (223538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971622.143999:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790971622.144528:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bd8a3b80 x1877969766198912/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790971637 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971622.144543:0:7004:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790971622.144569:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766198912:0@lo:700: 00000004:02000040:0.0:1790971622.263003:0:7004:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1790971622.280376:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766199168:0@lo:5: 00000100:00100000:1.0:1790971622.280463:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971622.280566:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971622.280726:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199168 00000100:00100000:0.0:1790971622.280736:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199168 00000100:00100000:0.0:1790971622.280796:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971622.280809:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7004:x1877969766199168:12345-0@lo:5: 00002000:00080000:2.0:1790971622.294056:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790971622.294081:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1790971622.301439:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7004:x1877969766199168:12345-0@lo:5: Request processed in 20627us (20970us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790971622.301451:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790971622.305508:0:7004:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd495acf800 x1877969766199168/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790971638 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971622.305529:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7004:1877969766199168:0@lo:5: 00000004:00080000:1.0:1790971622.305543:0:7004:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1790971622.502363:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790971622.632060:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790971623.525385:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971624.549656:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971625.573081:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971626.596754:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971626.855557:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766199680:0@lo:400: 00000100:00100000:0.0:1790971626.855632:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971626.855685:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971626.855691:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766199296:0@lo:400: 00000100:00100000:0.0:1790971626.855717:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971626.855744:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766199424:0@lo:400: 00000100:00100000:0.0:1790971626.855768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971626.855783:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971626.855789:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766199552:0@lo:400: 00000100:00100000:0.0:1790971626.855808:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971626.855848:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199680 00000100:00100000:0.0:1790971626.855856:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199680 00000100:00100000:0.0:1790971626.855910:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971626.855919:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766199680:12345-0@lo:400: 00000100:00100000:0.0:1790971626.855969:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766199680:12345-0@lo:400: Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971626.855976:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971626.855998:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199296 00000100:00100000:0.0:1790971626.856001:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199296 00000100:00100000:0.0:1790971626.856022:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790971626.856029:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3304:x1877969766199296:12345-0@lo:400: 00000100:00100000:0.0:1790971626.856060:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3304:x1877969766199296:12345-0@lo:400: Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971626.856065:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790971626.856092:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199424 00000100:00100000:0.0:1790971626.856096:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199424 00000100:00100000:0.0:1790971626.856117:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199552 00000100:00100000:0.0:1790971626.856120:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199552 00000100:00100000:0.0:1790971626.856135:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790971626.856141:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766199424:12345-0@lo:400: 00000100:00100000:0.0:1790971626.856171:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766199424:12345-0@lo:400: Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971626.856177:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790971626.856187:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790971626.856193:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766199552:12345-0@lo:400: 00000100:00100000:0.0:1790971626.856216:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766199552:12345-0@lo:400: Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971626.856221:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790971626.856261:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971626.856266:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790971626.856298:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2edf80 x1877969766199552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971626.856311:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766199552:0@lo:400: 00010000:00080000:0.0:1790971626.856322:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2eca80 x1877969766199424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971626.856330:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766199424:0@lo:400: 00000100:00100000:0.0:1790971626.856366:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766199296:0@lo:400: 00010000:00080000:0.0:1790971626.856378:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4be2ec380 x1877969766199680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971626.856386:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766199680:0@lo:400: 00000001:00080000:0.0:1790971627.192650:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1790971627.364651:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766199808:0@lo:13: 00000100:00100000:1.0:1790971627.364720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971627.364782:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199808 00000100:00100000:1.0:1790971627.364788:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199808 00000100:00100000:1.0:1790971627.364831:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971627.364840:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766199808:12345-0@lo:13: 00002000:00000024:1.0:1790971627.364873:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971627.364914:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766199808:12345-0@lo:13: Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971627.364921:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790971627.365978:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd495acf100 x1877969766199808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971627.366008:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790971627.366031:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766199808:0@lo:13: 00010000:00010000:1.0:1790971627.620628:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971628.644836:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971629.669523:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971630.692690:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971631.722902:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971631.974381:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766200320:0@lo:400: 00000100:00100000:2.0:1790971631.974446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971631.974514:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790971631.974521:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766200192:0@lo:400: 00000100:00100000:2.0:1790971631.974548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971631.974575:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200320 00000100:00100000:2.0:1790971631.974582:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200320 00000100:00100000:2.0:1790971631.974631:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971631.974639:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766200320:12345-0@lo:400: 00000100:00100000:2.0:1790971631.974691:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766200320:12345-0@lo:400: Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971631.974710:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790971631.974745:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bd8a3b80 x1877969766200320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971631.974758:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766200320:0@lo:400: 00000100:00100000:0.0:1790971631.974891:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766199936:0@lo:400: 00000100:00100000:0.0:1790971631.974925:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971631.974956:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971631.974962:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766200064:0@lo:400: 00000100:00100000:0.0:1790971631.974984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971631.975028:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200192 00000100:00100000:0.0:1790971631.975032:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200192 00000100:00100000:0.0:1790971631.975060:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200064 00000100:00100000:0.0:1790971631.975063:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200064 00000100:00100000:0.0:1790971631.975090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971631.975096:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766200192:12345-0@lo:400: 00000100:00100000:0.0:1790971631.975133:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766200192:12345-0@lo:400: Request processed in 37us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971631.975139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971631.975150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790971631.975156:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766200064:12345-0@lo:400: 00000100:00100000:0.0:1790971631.975185:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766200064:12345-0@lo:400: Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971631.975191:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1790971631.975217:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971631.975222:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790971631.975248:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bd8a1180 x1877969766200064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971631.975258:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766200064:0@lo:400: 00010000:00080000:0.0:1790971631.975278:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bd8a2d80 x1877969766200192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971631.975286:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766200192:0@lo:400: 00000100:00100000:2.0:1790971631.976232:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766199936 00000100:00100000:2.0:1790971631.976239:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766199936 00000100:00100000:2.0:1790971631.976284:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790971631.976292:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3302:x1877969766199936:12345-0@lo:400: 00000100:00100000:2.0:1790971631.976347:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3302:x1877969766199936:12345-0@lo:400: Request processed in 56us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971631.976354:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790971631.977158:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766199936:0@lo:400: 00000100:00100000:3.0:1790971632.490877:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790971632.490898:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766200448:0@lo:13: 00000100:00100000:3.0:1790971632.490963:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971632.491026:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200448 00000100:00100000:3.0:1790971632.491033:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200448 00000100:00100000:3.0:1790971632.491074:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790971632.491084:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766200448:12345-0@lo:13: 00002000:00000024:3.0:1790971632.491120:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971632.491162:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766200448:12345-0@lo:13: Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971632.491169:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790971632.491223:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4883f2680 x1877969766200448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971632.491240:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766200448:0@lo:13: 00010000:00010000:0.0:1790971632.741603:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971633.765335:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790971633.982194:0:7627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790971633.982199:0:7627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790971633.982512:0:7627:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cd4bfbb1000 00000020:01000004:0.0:1790971633.982526:0:7627:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790971633.982538:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790971633.982552:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cd49fdd3380) 00000020:00000080:0.0:1790971633.982566:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790971634.011416:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790971634.013827:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790971634.050669:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790971634.056415:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790971634.056448:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790971634.060695:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790971634.060756:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790971634.062266:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790971634.062278:0:7627:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790971634.062290:0:7627:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd3388eaa6f4941e 00000020:01000004:2.0:1790971634.062299:0:7627:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790971634.062320:0:7627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790971634.062324:0:7627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790971634.062329:0:7627:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790971634.062352:0:7627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790971634.062356:0:7627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790971634.092838:0:7627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790971634.092885:0:7627:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1790971634.092889:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790971634.092891:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971634.092893:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971634.092898:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971634.092900:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971634.092947:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971634.092948:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971634.092950:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790971634.092951:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790971634.092952:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971634.092954:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790971634.092958:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1790971634.092960:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790971634.092961:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971634.092962:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971634.092963:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971634.092964:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971634.092966:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971634.092966:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971634.092967:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790971634.092968:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790971634.092969:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971634.092970:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790971634.092994:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790971634.093011:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766200576:0@lo:253: 00000100:00100000:3.0:1790971634.093077:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971634.093282:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971634.093384:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200576 00000100:00100000:2.0:1790971634.093400:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200576 00000100:00100000:2.0:1790971634.093613:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790971634.093622:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:7627:x1877969766200576:12345-0@lo:253: 20000000:01000000:2.0:1790971634.093653:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790971634.093657:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1790971634.093661:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1790971634.093665:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1790971634.094731:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790971634.094970:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1790971634.094984:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1790971634.095028:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1790971634.095036:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1790971634.095070:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1790971634.095130:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1790971634.095567:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1790971634.095591:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:2.0:1790971634.095593:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:2.0:1790971634.095628:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1790971634.095636:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790971634.095680:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1790971634.095688:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:2.0:1790971634.095717:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1790971634.095726:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790971634.095758:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1790971634.095823:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1790971634.096577:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1790971634.096597:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:2.0:1790971634.096599:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:2.0:1790971634.096635:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1790971634.096643:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790971634.096672:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1790971634.096688:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:2.0:1790971634.096722:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1790971634.096731:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1790971634.096778:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1790971634.096817:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1790971634.096833:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790971634.096836:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790971634.096840:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790971634.096852:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790971634.096855:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790971634.096890:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790971634.096893:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790971634.098391:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1790971634.098585:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1790971634.098639:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1790971634.099121:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1790971634.099252:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1790971634.099318:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1790971634.099338:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790971634.099340:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790971634.099934:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1790971634.100246:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1790971634.100292:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1790971634.100356:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1790971634.100372:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790971634.100374:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790971634.101109:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1790971634.101252:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1790971634.101313:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1790971634.102232:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1790971634.102289:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1790971634.102380:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1790971634.102403:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790971634.102405:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790971634.103303:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1790971634.103366:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1790971634.103422:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1790971634.104006:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1790971634.104050:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1790971634.104083:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1790971634.104098:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790971634.104100:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790971634.104109:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790971634.104128:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104220:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104229:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104236:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104257:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104263:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104270:0:5832:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104305:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104318:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 16 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.104331:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766200704:0@lo:104: 00000100:00100000:0.0:1790971634.104398:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790971634.104513:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104521:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 16 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.104529:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766200832:0@lo:104: 00010000:00010000:0.0:1790971634.104555:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104563:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 16 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.104585:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766200960:0@lo:104: 00010000:00010000:0.0:1790971634.104613:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104621:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 16 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.104629:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766201088:0@lo:104: 00010000:00010000:0.0:1790971634.104651:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.104658:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 16 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.104666:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766201216:0@lo:104: 00000100:00100000:0.0:1790971634.104681:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3480 going to sleep for 11 seconds 00000100:00100000:2.0:1790971634.104875:0:5823:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790971634.104894:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.104956:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.105016:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.105037:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200704 00000100:00100000:0.0:1790971634.105044:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200704 00000100:00100000:0.0:1790971634.105077:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200832 00000100:00100000:0.0:1790971634.105079:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200832 00000100:00100000:0.0:1790971634.105091:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766200960 00000100:00100000:0.0:1790971634.105093:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766200960 00000100:00100000:0.0:1790971634.105106:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971634.105114:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+5:5832:x1877969766200704:12345-0@lo:104: 00010000:00010000:0.0:1790971634.105126:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105325:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790971634.105340:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+5:5832:x1877969766200704:12345-0@lo:104: Request processed in 226us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.105347:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971634.105390:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790971634.105396:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+4:5832:x1877969766200832:12345-0@lo:104: 00010000:00010000:0.0:1790971634.105404:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105442:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790971634.105448:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+4:5832:x1877969766200832:12345-0@lo:104: Request processed in 53us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.105454:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790971634.105467:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790971634.105494:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5832:x1877969766200960:12345-0@lo:104: 00010000:00010000:0.0:1790971634.105502:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105528:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790971634.105533:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5832:x1877969766200960:12345-0@lo:104: Request processed in 40us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.105538:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790971634.105554:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790971634.105560:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105566:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc200 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971634.105571:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105591:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971634.105598:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971634.105604:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971634.105632:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105639:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971634.105656:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105664:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc200/0xbd3388eaa6f49409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105676:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790971634.105679:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105685:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002dc00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971634.105688:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.105695:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.105811:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971634.105979:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.105986:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.105992:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935800 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971634.105995:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.106003:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971634.106021:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971634.106026:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790971634.106043:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.106049:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790971634.106064:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.106070:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f493c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.106082:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.106083:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.106085:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.106090:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.106091:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1790971634.106126:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971634.106217:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971634.106233:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.106240:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971634.106246:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.106252:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f493df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.106263:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971634.106264:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971634.106266:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971634.106290:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766201344:0@lo:103: 00000100:00100000:0.0:1790971634.106347:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.106444:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766201472:0@lo:103: 00000100:00100000:0.0:1790971634.106489:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.106556:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.106566:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201088 00000100:00100000:2.0:1790971634.106572:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201088 00000100:00100000:2.0:1790971634.106599:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201216 00000100:00100000:2.0:1790971634.106602:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201216 00000100:00100000:2.0:1790971634.106612:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790971634.106618:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:5832:x1877969766201088:12345-0@lo:104: 00010000:00010000:2.0:1790971634.106632:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.106676:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790971634.106681:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:5832:x1877969766201088:12345-0@lo:104: Request processed in 64us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971634.106688:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790971634.106718:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971634.106725:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5832:x1877969766201216:12345-0@lo:104: 00010000:00010000:2.0:1790971634.106733:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.106765:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790971634.106770:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5832:x1877969766201216:12345-0@lo:104: Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971634.106775:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790971634.106917:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766200704:0@lo:104: 00000100:00100000:1.0:1790971634.106926:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766200832:0@lo:104: 00000100:00100000:1.0:1790971634.106933:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766200960:0@lo:104: 00000100:00100000:1.0:1790971634.106940:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766201088:0@lo:104: 00000100:00100000:1.0:1790971634.106946:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1877969766201216:0@lo:104: 00010000:00010000:1.0:1790971634.106978:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.107016:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766201600:0@lo:103: 00000100:00100000:3.0:1790971634.107427:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201344 00000100:00100000:3.0:1790971634.107434:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201344 00010000:00010000:3.0:1790971634.107491:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 17 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971634.107517:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201472 00000100:00100000:3.0:1790971634.107521:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201472 00010000:00010000:3.0:1790971634.107533:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 18 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971634.107544:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790971634.107556:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3303:x1877969766201344:12345-0@lo:103: 00010000:00010000:3.0:1790971634.107567:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971634.107572:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 18 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.107583:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 18 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.107598:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f49410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49409 expref: 18 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.107614:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971634.107718:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.107852:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201600 00000100:00100000:1.0:1790971634.107856:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201600 00010000:00010000:1.0:1790971634.107874:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 18 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.107889:0:5825:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790971634.107896:0:5825:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790971634.107929:0:5826:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790971634.107938:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790971634.107944:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3304:x1877969766201472:12345-0@lo:103: 00010000:00010000:1.0:1790971634.107952:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971634.107957:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 18 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.107974:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 18 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.107984:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f493ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f493c3 expref: 18 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.107993:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971634.108029:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:3304:x1877969766201472:12345-0@lo:103: Request processed in 84us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.108036:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790971634.108052:0:5826:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790971634.108059:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790971634.108065:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3305:x1877969766201600:12345-0@lo:103: 00010000:00010000:1.0:1790971634.108072:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971634.108076:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 16 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.108085:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 16 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.108096:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002ce00/0xbd3388eaa6f493e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f493df expref: 16 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.108104:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971634.108133:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:3305:x1877969766201600:12345-0@lo:103: Request processed in 68us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.108224:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790971634.108261:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766201600:0@lo:103: 00000100:00100000:1.0:1790971634.108600:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766201472:0@lo:103: 00000100:00100000:3.0:1790971634.108688:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3303:x1877969766201344:12345-0@lo:103: Request processed in 1132us (2341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971634.108695:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1790971634.108728:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790971634.108734:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108742:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42200 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971634.108746:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108755:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971634.108762:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971634.108768:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790971634.108819:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108826:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790971634.108838:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108845:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108858:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971634.108862:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108879:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971634.108882:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108889:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971634.108896:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971634.108901:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790971634.108913:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108918:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790971634.108923:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108938:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f4936f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49376 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.108954:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.108956:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.108957:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.108964:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971634.112191:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766201856:0@lo:103: 00000100:00100000:0.0:1790971634.112291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.112367:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766201344:0@lo:103: 00000100:00100000:0.0:1790971634.112396:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790971634.112402:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766201728:0@lo:103: 00000100:00100000:0.0:1790971634.112424:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.112537:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201856 00000100:00100000:1.0:1790971634.112543:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201856 00010000:00010000:1.0:1790971634.112580:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 14 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.112604:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201728 00000100:00100000:1.0:1790971634.112607:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201728 00010000:00010000:1.0:1790971634.112617:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 15 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.112628:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790971634.112636:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:3303:x1877969766201856:12345-0@lo:103: 00010000:00010000:1.0:1790971634.112649:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971634.112654:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 15 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112663:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 15 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112680:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4936f expref: 15 pid: 5832 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112694:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971634.112746:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3303:x1877969766201856:12345-0@lo:103: Request processed in 109us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.112753:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790971634.112770:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790971634.112776:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:3303:x1877969766201728:12345-0@lo:103: 00010000:00010000:1.0:1790971634.112797:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971634.112802:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 13 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112811:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 13 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112821:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd42400/0xbd3388eaa6f493a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49399 expref: 13 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112835:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112844:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112860:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112866:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112872:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112879:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112886:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971634.112890:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112908:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112924:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112935:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971634.112959:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3303:x1877969766201728:12345-0@lo:103: Request processed in 183us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.112965:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790971634.112987:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.112995:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.113001:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f49425 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790971634.113015:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790971634.114285:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766201728:0@lo:103: 00000100:00100000:0.0:1790971634.114299:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766201856:0@lo:103: 00000100:00100000:2.0:1790971634.175422:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+11:7627:x1877969766200576:12345-0@lo:253: Request processed in 81793us (82335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971634.175437:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790971634.175551:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766200576:0@lo:253: 10000000:01000000:3.0:1790971634.175566:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790971634.175569:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790971634.175571:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971634.175572:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971634.175573:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1790971634.175575:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971634.175576:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971634.175577:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971634.175579:0:7627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790971634.175580:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971634.175582:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790971634.175603:0:7627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cd4bfbb1000 from lustre-OST0001 10000000:01000000:3.0:1790971634.175630:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790971634.175633:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790971634.175641:0:7627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cd48794cd40 local copy 10000000:01000000:3.0:1790971634.175644:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790971634.175679:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.175691:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.175780:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971634.175812:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766201984:0@lo:101: 00000100:00100000:3.0:1790971634.175848:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971634.175928:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.175969:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766201984 00000100:00100000:0.0:1790971634.175976:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766201984 00000100:00100000:0.0:1790971634.176061:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790971634.176071:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+11:7627:x1877969766201984:12345-0@lo:101: 00010000:00010000:0.0:1790971634.176085:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971634.176098:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f49433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4942c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.176122:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f49433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4942c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.176307:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f49433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4942c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.176318:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc200, rc 0) 00000100:00100000:0.0:1790971634.176364:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766201984:12345-0@lo:101: Request processed in 294us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.176371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790971634.176441:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766201984:0@lo:101: 00010000:00010000:3.0:1790971634.176453:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.176462:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971634.176584:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202112:0@lo:501: 00000100:00100000:3.0:1790971634.176611:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.180020:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766202112 00000100:00100000:2.0:1790971634.180036:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766202112 00000100:00100000:2.0:1790971634.180094:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790971634.180104:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202112:12345-0@lo:501: 00000100:00100000:3.0:1790971634.181386:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202112:12345-0@lo:501: Request processed in 1278us (4769us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790971634.181397:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790971634.182671:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971634.182724:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202112:0@lo:501: 10000000:01000000:1.0:1790971634.182753:0:7627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790971634.182810:0:7627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790971634.182820:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.182830:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.182850:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.182883:0:7627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971634.183054:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971634.183061:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.183069:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971634.183073:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.183083:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971634.183103:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971634.183109:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971634.183289:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.183297:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971634.183334:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.183340:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4942c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbd3388eaa6f49433 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.183359:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971634.183361:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971634.183363:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790971634.183401:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cd4bfbb1000 10000000:01000000:1.0:1790971634.183407:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790971634.183413:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790971634.183417:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790971634.183422:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790971634.183425:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790971634.183448:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.183456:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.183465:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.183515:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202368:0@lo:101: 00000100:00100000:1.0:1790971634.183576:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.183604:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1790971634.183625:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766202368 00000100:00100000:1.0:1790971634.183631:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766202368 00000100:00100000:1.0:1790971634.183675:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790971634.183683:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202368:12345-0@lo:101: 00010000:00010000:1.0:1790971634.183696:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971634.183709:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4943a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.183740:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.183750:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.183759:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43c00, rc 0) 00000100:00100000:1.0:1790971634.183796:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766202368:12345-0@lo:101: Request processed in 114us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.183803:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790971634.183847:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202368:0@lo:101: 00010000:00010000:1.0:1790971634.183860:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.183868:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.184807:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202496:0@lo:501: 00000100:00100000:1.0:1790971634.184869:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971634.184961:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971634.184974:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766202240:0@lo:103: 00000100:00100000:3.0:1790971634.185003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.185279:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1790971634.185303:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766202240 00000100:00100000:1.0:1790971634.185310:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766202240 00000100:00100000:1.0:1790971634.185360:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971634.185368:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:3305:x1877969766202240:12345-0@lo:103: 00010000:00010000:1.0:1790971634.185380:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971634.185401:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f49433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f4942c expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.185430:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971634.185492:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:3305:x1877969766202240:12345-0@lo:103: Request processed in 102us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.185500:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971634.185539:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766202240:0@lo:103: 00000100:00100000:1.0:1790971634.185558:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766202496 00000100:00100000:1.0:1790971634.185561:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766202496 00000100:00100000:0.0:1790971634.187339:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790971634.187361:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202496:12345-0@lo:501: 00000100:00100000:2.0:1790971634.187842:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202496:0@lo:501: 00000100:00100000:2.0:1790971634.187893:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202624:0@lo:503: 00000100:00100000:2.0:1790971634.187968:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.188008:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495b76780 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.188275:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202496:12345-0@lo:501: Request processed in 923us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.188284:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790971634.188316:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766202624 00000100:00100000:0.0:1790971634.188322:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766202624 00000100:00100000:0.0:1790971634.188349:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790971634.188357:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202624:12345-0@lo:503: 00000100:00100000:0.0:1790971634.194509:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202624:12345-0@lo:503: Request processed in 6145us (6532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.194540:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790971634.194721:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202624:0@lo:503: 00000040:00080000:2.0:1790971634.195048:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790971634.195388:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202752:0@lo:502: 00000100:00100000:2.0:1790971634.195445:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.195513:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495b76780 going to sleep for 11 seconds 00000100:00100000:3.0:1790971634.196693:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766202752 00000100:00100000:3.0:1790971634.196715:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766202752 00000100:00100000:3.0:1790971634.196765:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790971634.196775:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202752:12345-0@lo:502: 00000100:00100000:3.0:1790971634.197439:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202752:12345-0@lo:502: Request processed in 661us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971634.197448:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790971634.197654:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202752:0@lo:502: 00000040:00080000:2.0:1790971634.198122:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790971634.198309:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790971634.198349:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790971634.198399:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790971634.198437:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790971634.198521:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790971634.198559:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202880:0@lo:502: 00000100:00100000:2.0:1790971634.198621:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.198657:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495b76780 going to sleep for 11 seconds 00000100:00100000:3.0:1790971634.198820:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766202880 00000100:00100000:3.0:1790971634.198835:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766202880 00000100:00100000:3.0:1790971634.198874:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790971634.198882:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202880:12345-0@lo:502: 00000100:00100000:3.0:1790971634.199308:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766202880:12345-0@lo:502: Request processed in 424us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971634.199315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790971634.199432:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766202880:0@lo:502: 00000040:00080000:3.0:1790971634.201058:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790971634.201080:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790971634.202393:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790971634.202402:0:7636:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790971634.202408:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971634.202410:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790971634.202416:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790971634.202430:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cd4879499c0) 00000020:00000080:1.0:1790971634.202451:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790971634.202456:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790971634.202539:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4bfbb1000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790971634.202546:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790971634.202551:0:7636:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd3388eaa6f4944f 00010000:00010000:1.0:1790971634.209354:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790971634.210407:0:7636:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790971634.219674:0:7636:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790971634.220121:0:7636:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790971634.233125:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790971634.234518:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790971634.237948:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790971634.237962:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971634.237969:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971634.237972:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790971634.237975:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971634.237979:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971634.237980:0:7636:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790971634.237983:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790971634.237985:0:7636:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790971634.238048:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971634.238051:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971634.238053:0:7636:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790971634.238055:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790971634.249366:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1790971634.249413:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790971634.249436:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.249449:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971634.249457:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4bfbb1000 from 1 10000000:01000000:2.0:1790971634.249490:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971634.249529:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.249538:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.249549:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971634.249573:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203008:0@lo:101: 00000100:00100000:2.0:1790971634.249643:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.249693:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495b76780 going to sleep for 11 seconds 00000100:00100000:2.0:1790971634.251890:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203008 00000100:00100000:2.0:1790971634.251956:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203008 00000100:00100000:2.0:1790971634.252060:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790971634.252071:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:7627:x1877969766203008:12345-0@lo:101: 00010000:00010000:2.0:1790971634.252089:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971634.252111:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49456 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.252149:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.252161:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971634.252170:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934200, rc 0) 00000100:00100000:2.0:1790971634.252267:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203008:12345-0@lo:101: Request processed in 198us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971634.252292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790971634.254095:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203008:0@lo:101: 00010000:00010000:0.0:1790971634.254124:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.254135:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.254287:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203136:0@lo:501: 00000100:00100000:0.0:1790971634.254338:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.254848:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971634.254980:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203136 00000100:00100000:1.0:1790971634.254987:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203136 00000100:00100000:1.0:1790971634.255028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790971634.255038:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203136:12345-0@lo:501: 00000100:00100000:1.0:1790971634.255350:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203136:12345-0@lo:501: Request processed in 312us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.255358:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790971634.255894:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203136:0@lo:501: 00000100:00100000:0.0:1790971634.255958:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203264:0@lo:503: 00000100:00100000:0.0:1790971634.256004:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.256024:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3900 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.261688:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203264 00000100:00100000:0.0:1790971634.261722:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203264 00000100:00100000:0.0:1790971634.261785:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790971634.261795:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203264:12345-0@lo:503: 00000100:00100000:0.0:1790971634.262425:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203264:12345-0@lo:503: Request processed in 629us (6418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.262434:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790971634.262532:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203264:0@lo:503: 00000040:00080000:0.0:1790971634.264128:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790971634.265348:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203392:0@lo:502: 00000100:00100000:0.0:1790971634.265443:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.265509:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971634.266433:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203392 00000100:00100000:1.0:1790971634.266453:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203392 00000100:00100000:1.0:1790971634.266517:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790971634.266526:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203392:12345-0@lo:502: 00000100:00100000:0.0:1790971634.268716:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203392:12345-0@lo:502: Request processed in 2174us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.268733:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790971634.271108:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203392:0@lo:502: 00000040:00080000:2.0:1790971634.271680:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790971634.271825:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790971634.271866:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203520:0@lo:502: 00000100:00100000:2.0:1790971634.272222:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.272316:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495b763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971634.272375:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203520 00000100:00100000:3.0:1790971634.272383:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203520 00000100:00100000:3.0:1790971634.272507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790971634.272517:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203520:12345-0@lo:502: 00000100:00100000:3.0:1790971634.272877:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203520:12345-0@lo:502: Request processed in 362us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971634.272892:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790971634.273004:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203520:0@lo:502: 00000040:00080000:2.0:1790971634.273122:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790971634.273149:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790971634.273956:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971634.273967:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971634.273969:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790971634.273976:0:7640:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4bfbb1000 00000020:00000080:2.0:1790971634.273978:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790971634.273998:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971634.274001:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971634.274002:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790971634.274005:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790971634.274125:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790971634.274158:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790971634.274190:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.274202:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971634.274240:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790971634.274243:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cd4bfbb1000 10000000:01000000:1.0:1790971634.274246:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cd4bfbb1000 10000000:01000000:1.0:1790971634.274250:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790971634.274255:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4bfbb1000 from 1 10000000:01000000:1.0:1790971634.274258:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790971634.274290:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.274300:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.274309:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.274328:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203648:0@lo:101: 00000100:00100000:1.0:1790971634.274375:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.275119:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.275323:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203648 00000100:00100000:0.0:1790971634.275333:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203648 00000100:00100000:0.0:1790971634.275374:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790971634.275382:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766203648:12345-0@lo:101: 00010000:00010000:0.0:1790971634.275397:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971634.275412:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49464 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.275436:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.275447:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.275455:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbcc00, rc 0) 00000100:00100000:0.0:1790971634.275529:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766203648:12345-0@lo:101: Request processed in 146us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.275536:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790971634.275643:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203648:0@lo:101: 00010000:00010000:1.0:1790971634.275669:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971634.275677:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.275795:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203776:0@lo:501: 00000100:00100000:1.0:1790971634.275826:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.275848:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.276035:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203776 00000100:00100000:0.0:1790971634.276040:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203776 00000100:00100000:0.0:1790971634.276059:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790971634.276066:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766203776:12345-0@lo:501: 00000100:00100000:0.0:1790971634.276338:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766203776:12345-0@lo:501: Request processed in 271us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.276351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790971634.276510:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203776:0@lo:501: 00000100:00100000:1.0:1790971634.276540:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203904:0@lo:503: 00000100:00100000:1.0:1790971634.276581:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.276602:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1300 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.276653:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766203904 00000100:00100000:0.0:1790971634.276658:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766203904 00000100:00100000:0.0:1790971634.276679:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790971634.276686:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766203904:12345-0@lo:503: 00000100:00100000:0.0:1790971634.276860:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766203904:12345-0@lo:503: Request processed in 174us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.276867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790971634.277093:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766203904:0@lo:503: 00000040:00080000:1.0:1790971634.277463:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790971634.277600:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766204032:0@lo:502: 00000100:00100000:1.0:1790971634.277649:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.277670:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b251b000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.277810:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204032 00000100:00100000:0.0:1790971634.277815:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204032 00000100:00100000:0.0:1790971634.277840:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790971634.277847:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766204032:12345-0@lo:502: 00000100:00100000:0.0:1790971634.278411:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766204032:12345-0@lo:502: Request processed in 562us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.278420:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790971634.278552:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766204032:0@lo:502: 00000040:00080000:1.0:1790971634.278831:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790971634.278881:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790971634.279028:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790971634.279087:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790971634.279125:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790971634.279271:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790971634.279313:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790971634.279344:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790971634.279409:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790971634.279444:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790971634.279510:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790971634.279564:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790971634.279600:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790971634.279633:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790971634.279682:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790971634.279736:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790971634.279773:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790971634.279821:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790971634.279856:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790971634.279892:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790971634.280276:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790971634.280314:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790971634.280347:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790971634.280397:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790971634.280434:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790971634.280499:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790971634.280557:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790971634.280596:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790971634.280631:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790971634.280679:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790971634.280726:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790971634.280781:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790971634.280819:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790971634.280877:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790971634.281251:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790971634.281312:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790971634.281348:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790971634.281408:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766204160:0@lo:502: 00000100:00100000:1.0:1790971634.288275:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971634.288340:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1790971634.288536:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204160 00000100:00100000:2.0:1790971634.288546:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204160 00000100:00100000:2.0:1790971634.288610:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790971634.288623:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766204160:12345-0@lo:502: 00000100:00100000:2.0:1790971634.289138:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766204160:12345-0@lo:502: Request processed in 518us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971634.289146:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790971634.289291:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766204160:0@lo:502: 00000040:00080000:1.0:1790971634.289412:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1790971634.289428:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790971634.290316:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790971634.290332:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cd48794b380) 00000020:00000080:1.0:1790971634.290353:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1790971634.290424:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4bfbb1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790971634.290428:0:7641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4bfbb1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790971634.290431:0:7641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4bfbb1000 3 00010000:00080000:1.0:1790971634.290460:0:7641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd386fac800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1790971634.296091:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1790971634.296978:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790971634.297019:0:7641:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790971634.297031:0:7641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbd3388eaa6f49479 00000100:00080000:1.0:1790971634.297040:0:7641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790971634.297052:0:7641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cd386fac800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971634.297086:0:7641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd495acf800 x1877969766204288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790971634.297119:0:7641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790971634.297314:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766204288:0@lo:38: 00000100:00100000:3.0:1790971634.297389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.297614:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204288 00000100:00100000:0.0:1790971634.297621:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204288 00000100:00100000:0.0:1790971634.297653:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971634.297661:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1877969766204288:12345-0@lo:38: 00010000:00080000:0.0:1790971634.297684:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1790971634.298245:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbd3388eaa6f49480 00000004:00100000:0.0:1790971634.298264:0:5839:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790971634.298307:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8cd4be196800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971634.298388:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877969766204288:12345-0@lo:38: Request processed in 724us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.298398:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971634.298452:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766204544:0@lo:400: 00000100:00100000:0.0:1790971634.298514:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.298538:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971634.298546:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766204672:0@lo:400: 00000100:00100000:0.0:1790971634.298575:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.298612:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204544 00000100:00100000:0.0:1790971634.298617:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204544 00000100:00100000:2.0:1790971634.298638:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971634.298651:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766204416:0@lo:400: 00000100:00100000:0.0:1790971634.298661:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790971634.298673:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766204544:12345-0@lo:400: 00000100:00100000:2.0:1790971634.298691:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1790971634.300153:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1790971634.300171:0:7643:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8cd4bd8a2a00 x1877969766204800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971634.300196:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483127600 going to sleep for 0 seconds 00000100:00100000:0.0:1790971634.300250:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766204544:12345-0@lo:400: Request processed in 1578us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.300260:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000020:01000000:2.0:1790971634.300267:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:0.0:1790971634.300283:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204416 00000100:00100000:0.0:1790971634.300290:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204416 10000000:01000000:2.0:1790971634.300297:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790971634.300319:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.300319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790971634.300329:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766204416:12345-0@lo:400: 00010000:00010000:2.0:1790971634.300335:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790971634.300380:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790971634.300383:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790971634.300385:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971634.300388:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1790971634.300388:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766204416:12345-0@lo:400: Request processed in 60us (1695us total) trans 0 rc 0/0 00000020:01000004:2.0:1790971634.300391:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971634.300394:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971634.300397:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971634.300400:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971634.300403:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000100:00100000:0.0:1790971634.300403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000004:2.0:1790971634.300405:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971634.300408:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790971634.300412:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1790971634.300415:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790971634.300416:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790971634.300417:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971634.300419:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971634.300420:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971634.300421:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971634.300422:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971634.300423:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971634.300424:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971634.300425:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971634.300426:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1790971634.300436:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204672 00000100:00100000:0.0:1790971634.300441:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204672 10000000:01000000:2.0:1790971634.300444:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790971634.300455:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766204928:0@lo:253: 00000100:00100000:0.0:1790971634.300500:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971634.300511:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766204672:12345-0@lo:400: 00000100:00100000:2.0:1790971634.300519:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.300546:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483127b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971634.300561:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766204672:12345-0@lo:400: Request processed in 52us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971634.300568:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790971634.300584:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4c1ad3800 x1877969766204416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790971634.300591:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971634.300598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766204416:0@lo:400: 00000100:00080000:0.0:1790971634.300598:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971634.300634:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204928 00000100:00100000:2.0:1790971634.300638:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204928 00010000:00080000:0.0:1790971634.300646:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd495acf800 x1877969766204288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790971644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971634.300657:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790971634.300665:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00100000:2.0:1790971634.300668:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1790971634.300674:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:2.0:1790971634.300679:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:7627:x1877969766204928:12345-0@lo:253: 00000100:00080000:0.0:1790971634.300682:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790971634.300687:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd386fac800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790971634.300695:0:3301:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000159693e8): req@ffff8cd4bd8a2a00 x1877969766204800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 20000000:01000000:2.0:1790971634.300700:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1790971634.300715:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766204288:0@lo:38: 20000000:01000000:2.0:1790971634.300717:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790971634.301239:0:7643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971634.301267:0:7643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483127600 going to sleep for 11 seconds 00000100:00100000:1.0:1790971634.301274:0:5849:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766204800 00000100:00100000:1.0:1790971634.301281:0:5849:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766204800 00000100:00100000:1.0:1790971634.301328:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790971634.301337:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971634.301337:0:5849:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1877969766204800:12345-0@lo:901: 00000100:00100000:1.0:1790971634.301656:0:5849:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1877969766204800:12345-0@lo:901: Request processed in 320us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971634.301662:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790971634.301728:0:7643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bd8a2a00 x1877969766204800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790971650 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971634.301739:0:7643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a2a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1877969766204800:0@lo:901: 00010000:00080000:3.0:1790971634.307879:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4c1ad3b80 x1877969766204544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971634.307900:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766204544:0@lo:400: 00010000:00080000:2.0:1790971634.310986:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4c1ad3100 x1877969766204672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971634.311008:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766204672:0@lo:400: 20000000:01000000:3.0:1790971634.387147:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790971634.387170:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790971634.387252:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790971634.387257:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790971634.387282:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.387305:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.387313:0:5854:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.387360:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.387375:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 14 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.387389:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1877969766205056:0@lo:104: 00000100:00100000:0.0:1790971634.387457:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971634.387565:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38690eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971634.387626:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205056 00000100:00100000:3.0:1790971634.387634:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205056 00000100:00100000:3.0:1790971634.387690:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790971634.387711:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5854:x1877969766205056:12345-0@lo:104: 00010000:00010000:3.0:1790971634.387727:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.387783:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790971634.387790:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:5854:x1877969766205056:12345-0@lo:104: Request processed in 92us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971634.387796:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1790971634.387819:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971634.387825:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.387832:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43000 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971634.387837:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.387858:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971634.387866:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971634.388094:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1877969766205056:0@lo:104: 00010000:00010000:0.0:1790971634.388114:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971634.388160:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790971634.388205:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.388212:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790971634.388239:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.388248:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43000/0xbd3388eaa6f493d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f493d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.388268:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.388270:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971634.388272:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971634.388737:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766205184:0@lo:103: 00000100:00100000:1.0:1790971634.388809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971634.389837:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205184 00000100:00100000:3.0:1790971634.389850:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205184 00010000:00010000:3.0:1790971634.389905:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 15 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971634.389948:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790971634.389957:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b5252850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+15:3304:x1877969766205184:12345-0@lo:103: 00010000:00010000:3.0:1790971634.389970:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971634.389975:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 15 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.389999:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 15 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390017:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbce00/0xbd3388eaa6f493d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f493d1 expref: 15 pid: 5834 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390033:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390041:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790971634.390057:0:7634:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002801095s 00010000:00010000:3.0:1790971634.390062:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390069:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390077:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390083:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390090:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971634.390095:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390104:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390126:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971634.390137:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971634.390200:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b5252850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3304:x1877969766205184:12345-0@lo:103: Request processed in 244us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971634.390208:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790971634.390407:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.390416:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971634.390423:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc800/0xbd3388eaa6f49487 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971634.392585:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766205184:0@lo:103: 00000100:00100000:3.0:1790971634.402840:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:7627:x1877969766204928:12345-0@lo:253: Request processed in 102153us (102313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971634.402856:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790971634.403029:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0404db5-d37b-41bb-8054-1f8859117a4f:7627:1877969766204928:0@lo:253: 10000000:01000000:2.0:1790971634.403059:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790971634.403062:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790971634.403064:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790971634.403081:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971634.403082:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971634.403083:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971634.403085:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971634.403086:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971634.403088:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790971634.403089:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790971634.403092:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971634.403094:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790971634.403110:0:7627:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790971634.415446:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971634.415655:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790971634.417431:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971634.417672:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790971634.418615:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971634.419892:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790971634.424587:0:7627:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790971634.745099:0:7627:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790971634.745106:0:7627:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790971634.745135:0:7627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790971634.745201:0:7627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790971634.745214:0:7627:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790971634.745246:0:7627:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1790971634.788885:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971635.814917:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971636.842344:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971637.613097:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971637.613143:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766205312:0@lo:13: 00000100:00100000:0.0:1790971637.613252:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971637.613362:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205312 00000100:00100000:0.0:1790971637.613373:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205312 00000100:00100000:0.0:1790971637.613455:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971637.613467:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766205312:12345-0@lo:13: 00002000:00000024:0.0:1790971637.613554:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971637.613610:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766205312:12345-0@lo:13: Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971637.613618:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790971637.613668:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c1ad2d80 x1877969766205312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971637.613688:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766205312:0@lo:13: 00000100:00080000:2.0:1790971637.613961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790971637.861222:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971638.884741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971639.654894:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766205568:0@lo:400: 00000100:00100000:2.0:1790971639.654996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971639.655079:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790971639.655086:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766205440:0@lo:400: 00000100:00100000:2.0:1790971639.655123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971639.655157:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766205952:0@lo:400: 00000100:00100000:2.0:1790971639.655200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971639.655237:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766205696:0@lo:400: 00000100:00100000:2.0:1790971639.655263:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971639.655284:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971639.655289:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766205824:0@lo:400: 00000100:00100000:2.0:1790971639.655315:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971639.655349:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205568 00000100:00100000:2.0:1790971639.655360:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205568 00000100:00100000:2.0:1790971639.655403:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205952 00000100:00100000:2.0:1790971639.655406:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205952 00000100:00100000:2.0:1790971639.655429:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205696 00000100:00100000:2.0:1790971639.655432:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205696 00000100:00100000:2.0:1790971639.655448:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790971639.655721:0:5840:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790971639.655730:0:5840:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790971639.655747:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205440 00000100:00100000:3.0:1790971639.655751:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205440 00000100:00100000:3.0:1790971639.655776:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790971639.655782:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:3303:x1877969766205440:12345-0@lo:400: 00000100:00100000:3.0:1790971639.655853:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:3303:x1877969766205440:12345-0@lo:400: Request processed in 70us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971639.655861:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790971639.656057:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766205440:0@lo:400: 00000100:00100000:3.0:1790971639.656101:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790971639.656108:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766205952:12345-0@lo:400: 00000100:00100000:3.0:1790971639.656159:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766205952:12345-0@lo:400: Request processed in 51us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971639.656165:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790971639.656179:0:5840:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790971639.656185:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790971639.656190:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766205696:12345-0@lo:400: 00000100:00100000:3.0:1790971639.656222:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766205696:12345-0@lo:400: Request processed in 32us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971639.656228:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1790971639.656254:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bd8a1180 x1877969766205952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971639.656266:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766205952:0@lo:400: 00000100:00080000:3.0:1790971639.656427:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971639.657639:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766205824 00000100:00100000:0.0:1790971639.657653:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766205824 00000100:00100000:0.0:1790971639.657736:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971639.657746:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766205824:12345-0@lo:400: 00000100:00100000:0.0:1790971639.657840:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766205824:12345-0@lo:400: Request processed in 95us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971639.657848:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790971639.657879:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790971639.658698:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bd8a0000 x1877969766205696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971639.658720:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766205696:0@lo:400: 00010000:00080000:3.0:1790971639.658767:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bd8a2d80 x1877969766205824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971639.658804:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766205824:0@lo:400: 00000100:00100000:2.0:1790971639.659079:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766205568:12345-0@lo:400: 00000100:00100000:2.0:1790971639.659208:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766205568:12345-0@lo:400: Request processed in 3751us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971639.659219:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790971639.661267:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bd8a2a00 x1877969766205568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971639.661285:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766205568:0@lo:400: 00010000:00010000:1.0:1790971639.911598:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971640.933389:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790971641.749432:0:7987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790971641.961628:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790971642.726036:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790971642.726048:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4be529000 from 30 10000000:01000000:1.0:1790971642.726056:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790971642.726155:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.726169:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.726185:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971642.726221:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206080:0@lo:101: 00000100:00100000:1.0:1790971642.726334:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.726532:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093540 going to sleep for 11 seconds 00000100:00100000:3.0:1790971642.727885:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206080 00000100:00100000:3.0:1790971642.727903:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206080 00000100:00100000:3.0:1790971642.728219:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790971642.728232:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766206080:12345-0@lo:101: 00010000:00010000:3.0:1790971642.728256:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971642.728282:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4948e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.728321:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.728336:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.728345:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002da00, rc 0) 00000100:00100000:3.0:1790971642.728449:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766206080:12345-0@lo:101: Request processed in 220us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.728457:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790971642.728532:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971642.728551:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766206208:0@lo:13: 00000100:00100000:3.0:1790971642.728595:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.728649:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206208 00000100:00100000:3.0:1790971642.728667:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206208 00000100:00100000:3.0:1790971642.728712:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790971642.728719:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766206208:12345-0@lo:13: 00002000:00000024:3.0:1790971642.728755:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971642.728798:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766206208:12345-0@lo:13: Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.728805:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790971642.728827:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790971642.728869:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4883f2680 x1877969766206208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971642.728891:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766206208:0@lo:13: 00000100:00100000:3.0:1790971642.730545:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206080:0@lo:101: 00010000:00010000:3.0:1790971642.730592:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.730608:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971642.730735:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206336:0@lo:501: 00000100:00100000:3.0:1790971642.730811:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.730924:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a0900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971642.735082:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206336 00000100:00100000:1.0:1790971642.735109:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206336 00000100:00100000:3.0:1790971642.735307:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790971642.735324:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766206336:12345-0@lo:501: 00000100:00100000:0.0:1790971642.736109:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206336:0@lo:501: 00000100:00100000:0.0:1790971642.736201:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206464:0@lo:503: 00000100:00100000:0.0:1790971642.736286:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.736337:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74600 going to sleep for 11 seconds 00000100:00100000:3.0:1790971642.736465:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766206336:12345-0@lo:501: Request processed in 595us (5103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.736505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790971642.736559:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206464 00000100:00100000:3.0:1790971642.736565:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206464 00000100:00100000:3.0:1790971642.736595:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790971642.736603:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766206464:12345-0@lo:503: 00000100:00100000:3.0:1790971642.737568:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766206464:12345-0@lo:503: Request processed in 959us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.737578:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790971642.737740:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206464:0@lo:503: 00000100:00100000:2.0:1790971642.755052:0:8026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8026:1877969766206592:0@lo:502: 00000100:00100000:2.0:1790971642.756326:0:8026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.756408:0:8026:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886a63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971642.757036:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206592 00000100:00100000:3.0:1790971642.757050:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206592 00000100:00100000:3.0:1790971642.757148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790971642.757161:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8026:x1877969766206592:12345-0@lo:502: 00000100:00100000:3.0:1790971642.757707:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8026:x1877969766206592:12345-0@lo:502: Request processed in 546us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.757717:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790971642.758040:0:8026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8026:1877969766206592:0@lo:502: 00000100:00100000:2.0:1790971642.758158:0:8026:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8026:1877969766206720:0@lo:502: 00000100:00100000:2.0:1790971642.758215:0:8026:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.758258:0:8026:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30540 going to sleep for 11 seconds 00000100:00100000:3.0:1790971642.758426:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206720 00000100:00100000:3.0:1790971642.758432:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206720 00000100:00100000:3.0:1790971642.758509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790971642.758519:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8026:x1877969766206720:12345-0@lo:502: 00000100:00100000:3.0:1790971642.758784:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8026:x1877969766206720:12345-0@lo:502: Request processed in 267us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.758792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790971642.758919:0:8026:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8026:1877969766206720:0@lo:502: 00000040:00080000:0.0:1790971642.758958:0:8026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790971642.760035:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790971642.760570:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790971642.760588:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.760605:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971642.760631:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790971642.760634:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790971642.760637:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790971642.761027:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.761039:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.761052:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971642.761221:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206848:0@lo:101: 00000100:00100000:3.0:1790971642.761322:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.761390:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a0900 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.762055:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206848 00000100:00100000:2.0:1790971642.762069:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206848 00000100:00100000:2.0:1790971642.762151:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790971642.762162:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766206848:12345-0@lo:101: 00010000:00010000:2.0:1790971642.762184:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971642.762209:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4949c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.762246:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.762258:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.762269:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934c00, rc 0) 00000100:00100000:2.0:1790971642.762350:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766206848:12345-0@lo:101: Request processed in 190us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.762366:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790971642.762452:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206848:0@lo:101: 00010000:00010000:0.0:1790971642.762499:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.762513:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971642.762629:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206976:0@lo:501: 00000100:00100000:0.0:1790971642.762680:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.762712:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feece40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971642.763197:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766206976 00000100:00100000:3.0:1790971642.763206:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766206976 00000100:00100000:3.0:1790971642.763257:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790971642.763266:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766206976:12345-0@lo:501: 00000100:00100000:3.0:1790971642.765454:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766206976:12345-0@lo:501: Request processed in 2174us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.765495:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790971642.765691:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766206976:0@lo:501: 00000100:00100000:0.0:1790971642.765767:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207104:0@lo:503: 00000100:00100000:0.0:1790971642.765839:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.765884:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feece40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.766695:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766207104 00000100:00100000:2.0:1790971642.766710:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766207104 00000100:00100000:2.0:1790971642.766775:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790971642.766788:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766207104:12345-0@lo:503: 00000100:00100000:2.0:1790971642.767301:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766207104:12345-0@lo:503: Request processed in 513us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.767311:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790971642.767373:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207104:0@lo:503: 00000100:00100000:3.0:1790971642.768336:0:8029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8029:1877969766207232:0@lo:502: 00000100:00100000:3.0:1790971642.768433:0:8029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.768530:0:8029:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971642.769043:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766207232 00000100:00100000:0.0:1790971642.769053:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766207232 00000100:00100000:0.0:1790971642.769204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790971642.769216:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8029:x1877969766207232:12345-0@lo:502: 00000100:00100000:0.0:1790971642.770571:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8029:x1877969766207232:12345-0@lo:502: Request processed in 1347us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971642.770585:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790971642.773750:0:8029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8029:1877969766207232:0@lo:502: 00000020:01000000:3.0:1790971642.773814:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971642.773836:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971642.773840:0:8029:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790971642.773848:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790971642.773850:0:8029:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790971642.773968:0:8029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8029:1877969766207360:0@lo:502: 00000100:00100000:3.0:1790971642.774081:0:8029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.774168:0:8029:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.776515:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766207360 00000100:00100000:2.0:1790971642.776535:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766207360 00000100:00100000:2.0:1790971642.776609:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790971642.776622:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8029:x1877969766207360:12345-0@lo:502: 00000100:00100000:2.0:1790971642.777039:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8029:x1877969766207360:12345-0@lo:502: Request processed in 418us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.777048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790971642.778007:0:8029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8029:1877969766207360:0@lo:502: 00000020:01000000:3.0:1790971642.778068:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971642.778091:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971642.778094:0:8029:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790971642.778100:0:8029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790971642.778746:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790971642.778778:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790971642.778793:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.778809:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971642.778822:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790971642.778840:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4b52bc800 from 30 10000000:01000000:1.0:1790971642.778843:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790971642.778897:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.778907:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.779004:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971642.779038:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207488:0@lo:101: 00000100:00100000:1.0:1790971642.779144:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.779200:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd3810933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971642.779318:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766207488 00000100:00100000:3.0:1790971642.779328:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766207488 00000100:00100000:3.0:1790971642.779386:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790971642.779398:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766207488:12345-0@lo:101: 00010000:00010000:3.0:1790971642.779420:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971642.779438:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f494aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.779500:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.779516:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.779527:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d000, rc 0) 00000100:00100000:3.0:1790971642.779585:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766207488:12345-0@lo:101: Request processed in 188us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.779592:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790971642.779765:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207488:0@lo:101: 00010000:00010000:1.0:1790971642.779784:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.779795:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971642.779866:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207616:0@lo:501: 00000100:00100000:1.0:1790971642.779898:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.779962:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd3810933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.784774:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766207616 00000100:00100000:2.0:1790971642.784795:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766207616 00000100:00100000:1.0:1790971642.786373:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790971642.786392:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766207616:12345-0@lo:501: 00000100:00100000:1.0:1790971642.786909:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766207616:12345-0@lo:501: Request processed in 519us (7007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971642.787180:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790971642.787270:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207616:0@lo:501: 00000100:00100000:1.0:1790971642.787357:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207744:0@lo:503: 00000100:00100000:1.0:1790971642.787430:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.789076:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd3810933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971642.789140:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766207744 00000100:00100000:1.0:1790971642.789150:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766207744 00000100:00100000:2.0:1790971642.792180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790971642.792204:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766207744:12345-0@lo:503: 00000100:00100000:2.0:1790971642.794225:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766207744:12345-0@lo:503: Request processed in 2013us (6778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.794245:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790971642.794514:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766207744:0@lo:503: 00000100:00100000:3.0:1790971642.803037:0:8032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8032:1877969766207872:0@lo:502: 00000100:00100000:3.0:1790971642.803305:0:8032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.803365:0:8032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971642.805140:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766207872 00000100:00100000:1.0:1790971642.805165:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766207872 00000100:00100000:1.0:1790971642.805263:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790971642.805276:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8032:x1877969766207872:12345-0@lo:502: 00000100:00100000:1.0:1790971642.805732:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8032:x1877969766207872:12345-0@lo:502: Request processed in 457us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971642.805743:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790971642.805851:0:8032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8032:1877969766207872:0@lo:502: 00000100:00100000:1.0:1790971642.806238:0:8032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8032:1877969766208000:0@lo:502: 00000100:00100000:1.0:1790971642.806300:0:8032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.806329:0:8032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.806514:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208000 00000100:00100000:2.0:1790971642.806521:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208000 00000100:00100000:2.0:1790971642.806564:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790971642.806574:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8032:x1877969766208000:12345-0@lo:502: 00000100:00100000:2.0:1790971642.806823:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8032:x1877969766208000:12345-0@lo:502: Request processed in 250us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.806832:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790971642.808301:0:8032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8032:1877969766208000:0@lo:502: 00000040:00080000:1.0:1790971642.808366:0:8032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790971642.809569:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790971642.809617:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790971642.809641:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.809658:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971642.809676:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790971642.809681:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd4b52bc800 from 5 10000000:01000000:2.0:1790971642.809685:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790971642.809751:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.809761:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.809775:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971642.809814:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208128:0@lo:101: 00000100:00100000:2.0:1790971642.809935:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.810008:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b33180 going to sleep for 11 seconds 00000100:00100000:1.0:1790971642.810810:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208128 00000100:00100000:1.0:1790971642.810824:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208128 00000100:00100000:1.0:1790971642.810898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790971642.810911:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766208128:12345-0@lo:101: 00010000:00010000:1.0:1790971642.810942:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971642.810970:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42600/0xbd3388eaa6f494bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f494b8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.811005:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42600/0xbd3388eaa6f494bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f494b8 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.811019:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd42600/0xbd3388eaa6f494bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f494b8 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971642.811030:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42600, rc 0) 00000100:00100000:1.0:1790971642.811139:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766208128:12345-0@lo:101: Request processed in 230us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971642.811148:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790971642.811651:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208128:0@lo:101: 00010000:00010000:3.0:1790971642.811677:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.811689:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971642.811778:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208256:0@lo:256: 00000100:00100000:3.0:1790971642.811840:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.811867:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971642.811947:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208256 00000100:00100000:1.0:1790971642.811954:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208256 00000100:00100000:1.0:1790971642.811999:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790971642.812008:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766208256:12345-0@lo:256: 20000000:01000000:1.0:1790971642.812030:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790971642.812053:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790971642.812057:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790971642.812340:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766208256:12345-0@lo:256: Request processed in 331us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971642.812349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790971642.812431:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208256:0@lo:256: 10000000:01000000:3.0:1790971642.813560:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790971642.813578:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.813592:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971642.813603:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790971642.813606:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1790971642.813609:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790971642.813651:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.813661:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971642.813679:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971642.813703:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208384:0@lo:101: 00000100:00100000:3.0:1790971642.813763:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971642.814189:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.821383:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208384 00000100:00100000:2.0:1790971642.821404:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208384 00000100:00100000:2.0:1790971642.821498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790971642.821510:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766208384:12345-0@lo:101: 00010000:00010000:2.0:1790971642.821544:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971642.821570:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f494c6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.821609:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.821624:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971642.821634:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494935200, rc 0) 00000100:00100000:2.0:1790971642.821738:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766208384:12345-0@lo:101: Request processed in 230us (7974us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.821745:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790971642.821904:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208384:0@lo:101: 00010000:00010000:0.0:1790971642.821941:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.821951:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971642.822038:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208512:0@lo:501: 00000100:00100000:0.0:1790971642.822093:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.822137:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec600 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.822313:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208512 00000100:00100000:2.0:1790971642.822318:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208512 00000100:00100000:2.0:1790971642.822355:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790971642.822363:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766208512:12345-0@lo:501: 00000100:00100000:2.0:1790971642.822718:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766208512:12345-0@lo:501: Request processed in 355us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.822726:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790971642.822779:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208512:0@lo:501: 00000100:00100000:2.0:1790971642.822816:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208640:0@lo:503: 00000100:00100000:2.0:1790971642.822858:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.822873:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21540 going to sleep for 11 seconds 00000100:00100000:0.0:1790971642.823411:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208640 00000100:00100000:0.0:1790971642.823419:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208640 00000100:00100000:0.0:1790971642.823463:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790971642.823485:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766208640:12345-0@lo:503: 00000100:00100000:0.0:1790971642.829302:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766208640:12345-0@lo:503: Request processed in 5810us (6420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971642.829326:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790971642.834201:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766208640:0@lo:503: 00000100:00100000:1.0:1790971642.840987:0:8039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8039:1877969766208768:0@lo:502: 00000100:00100000:1.0:1790971642.841204:0:8039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.841264:0:8039:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd3810936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971642.841322:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208768 00000100:00100000:3.0:1790971642.841333:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208768 00000100:00100000:3.0:1790971642.841400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790971642.841412:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8039:x1877969766208768:12345-0@lo:502: 00000100:00100000:3.0:1790971642.841868:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8039:x1877969766208768:12345-0@lo:502: Request processed in 456us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.841878:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790971642.842065:0:8039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8039:1877969766208768:0@lo:502: 00000020:01000000:1.0:1790971642.842213:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790971642.842232:0:8039:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790971642.842243:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971642.842245:0:8039:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790971642.842255:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790971642.842261:0:8039:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1790971642.842295:0:8039:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790971642.842298:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790971642.842334:0:8039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cd4be040000) 00000020:00000080:1.0:1790971642.842361:0:8039:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790971642.842368:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790971642.842516:0:8039:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790971642.842524:0:8039:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790971642.842534:0:8039:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f494db 00010000:00080000:1.0:1790971642.842582:0:8039:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd4883e9800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1790971642.843149:0:8039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1790971642.844373:0:8039:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790971642.844392:0:8039:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790971642.845788:0:8039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790971642.846687:0:8039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790971642.846756:0:8039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1790971642.846825:0:8039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790971642.847855:0:8040:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790971642.847861:0:8040:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790971642.856277:0:8039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790971642.856298:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790971642.856350:0:8039:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790971642.856381:0:8039:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f494e2 00000100:00080000:0.0:1790971642.856398:0:8039:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790971642.856414:0:8039:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cd4883e9800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1790971642.856498:0:8039:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4c1ad0700 x1877969766208896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790971642.856538:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766208896:0@lo:8: 00000100:00100000:0.0:1790971642.856656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.856737:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766208896 00000100:00100000:0.0:1790971642.856748:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766208896 00000100:00100000:0.0:1790971642.856786:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790971642.856794:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3301:x1877969766208896:12345-0@lo:8: 00010000:00080000:0.0:1790971642.856828:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1790971642.856862:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f494e9 00002000:00100000:0.0:1790971642.856879:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cd4be191800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790971642.856899:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1790971642.856904:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790971642.857082:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790971642.857296:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790971642.857344:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cd4be191000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971642.857427:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877969766208896:12345-0@lo:8: Request processed in 631us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971642.857437:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790971642.857534:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c1ad0700 x1877969766208896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790971652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971642.857545:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790971642.857554:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790971642.857562:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790971642.857568:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790971642.857570:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4883e9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790971642.857594:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790971642.857600:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766208896:0@lo:8: 00000100:00080000:0.0:1790971642.857624:0:8039:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790971642.857705:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971642.857712:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971642.857714:0:8039:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790971642.857718:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790971642.857722:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971642.857723:0:8039:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790971642.857726:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790971642.857728:0:8039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790971642.857764:0:8039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8039:1877969766209024:0@lo:502: 00000100:00100000:0.0:1790971642.857820:0:8039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.857852:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209024 00000100:00100000:0.0:1790971642.857857:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209024 00000100:00100000:0.0:1790971642.857894:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790971642.857902:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8039:x1877969766209024:12345-0@lo:502: 00000100:00100000:0.0:1790971642.858174:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8039:x1877969766209024:12345-0@lo:502: Request processed in 271us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971642.858189:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790971642.858235:0:8039:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971642.858247:0:8039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8039:1877969766209024:0@lo:502: 00000020:01000000:0.0:1790971642.858273:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971642.858278:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971642.858280:0:8039:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790971642.858284:0:8039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1790971642.858352:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1790971642.858373:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790971642.858386:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.858398:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971642.858410:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790971642.858413:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cd48794cd40 from 1 10000000:01000000:0.0:1790971642.858416:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790971642.858443:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.858452:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.858462:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971642.858493:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766209152:0@lo:101: 00000100:00100000:0.0:1790971642.858525:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.858547:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971642.858563:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209152 00000100:00100000:0.0:1790971642.858568:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209152 00000100:00100000:0.0:1790971642.858590:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790971642.858597:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766209152:12345-0@lo:101: 00010000:00010000:0.0:1790971642.858608:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971642.858624:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f494f0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.858651:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.858663:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.858672:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd000, rc 0) 00000100:00100000:0.0:1790971642.858699:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766209152:12345-0@lo:101: Request processed in 103us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971642.858705:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790971642.858734:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766209152:0@lo:101: 00010000:00010000:0.0:1790971642.858748:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.858756:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971642.858800:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766209280:0@lo:501: 00000100:00100000:0.0:1790971642.858823:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.858834:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971642.858851:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209280 00000100:00100000:0.0:1790971642.858855:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209280 00000100:00100000:0.0:1790971642.858874:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790971642.858881:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766209280:12345-0@lo:501: 00000100:00100000:0.0:1790971642.859107:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766209280:12345-0@lo:501: Request processed in 226us (282us total) trans 0 rc -2/-2 00000004:00080000:3.0:1790971642.859366:0:8040:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790971642.859839:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766209536:0@lo:400: 00000100:00100000:1.0:1790971642.860612:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.860664:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790971642.860672:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766209408:0@lo:400: 00000100:00100000:1.0:1790971642.860718:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971642.860753:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766209664:0@lo:400: 00000100:00100000:1.0:1790971642.860781:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1790971642.860827:0:8040:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 221800354956ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790971642.860858:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209536 00000100:00100000:3.0:1790971642.860865:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209536 00000100:00100000:3.0:1790971642.860915:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209408 00000100:00100000:3.0:1790971642.860918:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209408 00000100:00100000:3.0:1790971642.860929:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209664 00000100:00100000:3.0:1790971642.860931:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209664 00000100:00100000:3.0:1790971642.860945:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790971642.860953:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766209536:12345-0@lo:400: 00000100:00100000:3.0:1790971642.861017:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766209536:12345-0@lo:400: Request processed in 64us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.861039:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790971642.861060:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790971642.861064:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766209408:12345-0@lo:400: 00000100:00100000:3.0:1790971642.861094:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766209408:12345-0@lo:400: Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.861100:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790971642.861111:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790971642.861128:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766209664:12345-0@lo:400: 00000100:00080000:2.0:1790971642.861534:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971642.863010:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790971642.863630:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766209664:12345-0@lo:400: Request processed in 2507us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971642.863646:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1790971642.864713:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495ace680 x1877969766209664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971642.864735:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766209664:0@lo:400: 00000100:00100000:0.0:1790971642.865592:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766209280:0@lo:501: 10000000:01000000:0.0:1790971642.865652:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790971642.865666:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971642.865679:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1790971642.869155:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495aced80 x1877969766209408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971642.869198:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766209408:0@lo:400: 00010000:00080000:1.0:1790971642.869219:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495acea00 x1877969766209536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971642.869227:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766209536:0@lo:400: 00000004:00080000:2.0:1790971642.954453:0:8041:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790971642.954520:0:8041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766209920:0@lo:7: 00000100:00100000:2.0:1790971642.954621:0:8041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.954692:0:8041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.954754:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790971642.954768:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766209792:0@lo:13: 00000100:00100000:2.0:1790971642.954800:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.954836:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209920 00000100:00100000:2.0:1790971642.954845:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209920 00000100:00100000:2.0:1790971642.954920:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790971642.954931:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8041:x1877969766209920:12345-0@lo:7: 00002000:00080000:2.0:1790971642.960990:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790971642.961001:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00010000:00080000:0.0:1790971642.962319:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8ed80 x1877969766209920/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790971658 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971642.962343:0:8041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766209920:0@lo:7: 00000004:00080000:0.0:1790971642.962363:0:8041:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790971642.962432:0:8041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766210048:0@lo:5: 00000100:00100000:0.0:1790971642.962520:0:8041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971642.962580:0:8041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec180 going to sleep for 11 seconds 00000100:00100000:0.0:1790971642.962611:0:6689:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790971642.962618:0:6689:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790971642.962938:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8041:x1877969766209920:12345-0@lo:7: Request processed in 8006us (8315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.962949:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790971642.963005:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766209792 00000100:00100000:2.0:1790971642.963016:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766209792 00000100:00100000:2.0:1790971642.963095:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790971642.963106:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766209792:12345-0@lo:13: 00002000:00000024:2.0:1790971642.963171:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790971642.963244:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766209792:12345-0@lo:13: Request processed in 140us (8442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971642.963251:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790971642.963274:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971642.963288:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210048 00000100:00100000:2.0:1790971642.963291:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210048 00000100:00100000:2.0:1790971642.963308:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790971642.963313:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8041:x1877969766210048:12345-0@lo:5: 00002000:00080000:2.0:1790971642.963356:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790971642.963360:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790971642.963980:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8041:x1877969766210048:12345-0@lo:5: Request processed in 662us (1457us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790971642.963989:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790971642.964060:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8d180 x1877969766209792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971642.964086:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766209792:0@lo:13: 00010000:00080000:2.0:1790971642.964145:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c1ad0700 x1877969766210048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790971658 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971642.964158:0:8041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766210048:0@lo:5: 00000004:00080000:2.0:1790971642.964172:0:8041:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790971642.964222:0:8041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766210176:0@lo:700: 00000100:00100000:2.0:1790971642.964262:0:8041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.964297:0:8041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.964313:0:6697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210176 00000100:00100000:2.0:1790971642.964319:0:6697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210176 00000100:00100000:2.0:1790971642.964357:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971642.964365:0:6697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8041:x1877969766210176:12345-0@lo:700: 00000100:00100000:2.0:1790971642.964404:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1877969766210304:0@lo:700: 00000100:00100000:2.0:1790971642.964437:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971642.964455:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790971642.964663:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210304 00000100:00100000:2.0:1790971642.964671:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210304 00000100:00100000:2.0:1790971642.964801:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971642.964810:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1877969766210304:12345-0@lo:700: 00010000:00010000:2.0:1790971642.980770:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790971643.005583:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1790971643.059187:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1790971643.070382:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1877969766210304:12345-0@lo:700: Request processed in 105555us (105925us total) trans 0 rc 0/0 00010000:00080000:3.0:1790971643.073369:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8dc00 x1877969766210304/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790971658 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971643.073398:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1877969766210304:0@lo:700: 00000100:00100000:1.0:1790971643.073583:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 40000000:02000000:3.0:1790971643.074582:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1790971643.260681:0:6697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8041:x1877969766210176:12345-0@lo:700: Request processed in 296301us (296402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971643.260706:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1790971643.261525:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790971643.261553:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1790971643.269996:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8d180 x1877969766210176/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790971658 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971643.270030:0:8041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766210176:0@lo:700: 00000004:02000040:1.0:1790971643.341533:0:8041:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1790971643.349203:0:8041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766210432:0@lo:5: 00000100:00100000:2.0:1790971643.349309:0:8041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971643.349373:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210432 00000100:00100000:2.0:1790971643.349384:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210432 00000100:00100000:2.0:1790971643.349449:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790971643.349460:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8041:x1877969766210432:12345-0@lo:5: 00000100:00100000:3.0:1790971643.354412:0:8041:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21cc0 going to sleep for 11 seconds 00002000:00080000:1.0:1790971643.362703:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1790971643.363361:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1790971643.367847:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8041:x1877969766210432:12345-0@lo:5: Request processed in 18374us (18527us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790971643.367875:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790971643.368212:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8d180 x1877969766210432/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790971659 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971643.368234:0:8041:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790971643.368258:0:8041:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cd386c8d180 x1877969766210432/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790971659 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971643.368274:0:8041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1877969766210432:0@lo:5: 00000004:00080000:2.0:1790971643.368296:0:8041:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1790971644.004797:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971645.030256:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971646.053079:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971647.077909:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790971647.372378:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1790971647.849809:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790971647.849835:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766210560:0@lo:13: 00000100:00100000:1.0:1790971647.849905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971647.850151:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210560 00000100:00100000:0.0:1790971647.850160:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210560 00000100:00100000:0.0:1790971647.850298:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971647.850308:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766210560:12345-0@lo:13: 00002000:00000024:0.0:1790971647.850343:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971647.850402:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766210560:12345-0@lo:13: Request processed in 96us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971647.850410:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790971647.850505:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495acea00 x1877969766210560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971647.850527:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766210560:0@lo:13: 00000100:00080000:1.0:1790971647.851885:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790971648.102641:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971648.356884:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766210688:0@lo:13: 00000100:00100000:1.0:1790971648.356970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971648.357072:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210688 00000100:00100000:1.0:1790971648.357088:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210688 00000100:00100000:1.0:1790971648.357138:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790971648.357147:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766210688:12345-0@lo:13: 00002000:00000024:1.0:1790971648.357181:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790971648.357393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971648.357433:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766210688:12345-0@lo:13: Request processed in 287us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971648.357441:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790971648.357668:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766210816:0@lo:400: 00000100:00100000:3.0:1790971648.359361:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766211072:0@lo:400: 00000100:00100000:1.0:1790971648.360646:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766210944:0@lo:400: 00010000:00080000:0.0:1790971648.366720:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8df80 x1877969766210688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971648.366737:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790971648.366778:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766210688:0@lo:13: 00000100:00100000:0.0:1790971648.366816:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766211200:0@lo:400: 00000100:00100000:0.0:1790971648.366888:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971648.367567:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211200 00000100:00100000:0.0:1790971648.367577:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211200 00000100:00100000:0.0:1790971648.367638:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790971648.367649:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766211200:12345-0@lo:400: 00000100:00100000:0.0:1790971648.367711:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766211200:12345-0@lo:400: Request processed in 64us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971648.367718:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790971648.367748:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8d500 x1877969766211200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971648.367776:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766211200:0@lo:400: 00000100:00100000:2.0:1790971648.371560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971648.371599:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210816 00000100:00100000:2.0:1790971648.371609:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210816 00000100:00100000:2.0:1790971648.371652:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790971648.371662:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766210816:12345-0@lo:400: 00000100:00100000:2.0:1790971648.371713:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766210816:12345-0@lo:400: Request processed in 52us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971648.371734:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790971648.371792:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766210816:0@lo:400: 00000100:00100000:2.0:1790971648.371803:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766211328:0@lo:400: 00000100:00100000:2.0:1790971648.371832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971648.371856:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211328 00000100:00100000:2.0:1790971648.371859:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211328 00000100:00100000:2.0:1790971648.371905:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790971648.371915:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766211328:12345-0@lo:400: 00000100:00100000:2.0:1790971648.371960:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766211328:12345-0@lo:400: Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971648.371966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790971648.371983:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790971648.372002:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8dc00 x1877969766211328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971648.372015:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766211328:0@lo:400: 00000100:00100000:3.0:1790971648.372563:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971648.372688:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971648.372777:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211072 00000100:00100000:3.0:1790971648.372783:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211072 00000100:00100000:3.0:1790971648.372828:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766210944 00000100:00100000:3.0:1790971648.372831:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766210944 00000100:00100000:3.0:1790971648.372864:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790971648.372872:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766211072:12345-0@lo:400: 00000100:00100000:3.0:1790971648.372944:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766211072:12345-0@lo:400: Request processed in 72us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971648.372955:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790971648.372972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790971648.372978:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766210944:12345-0@lo:400: 00000100:00100000:3.0:1790971648.373008:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766210944:12345-0@lo:400: Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971648.373013:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790971648.373054:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8e300 x1877969766211072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971648.373065:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766211072:0@lo:400: 00010000:00080000:1.0:1790971648.373392:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8d880 x1877969766210944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971648.373401:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766210944:0@lo:400: 00000100:00080000:0.0:1790971648.373563:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971648.873085:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971648.873159:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745215872 00000100:00100000:0.0:1790971648.873171:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745215872 00000100:00100000:0.0:1790971648.873218:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:0.0:1790971648.873226:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1877969745215872:12345-192.168.203.43@tcp:250: 00010000:00080000:0.0:1790971648.873256:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7b6100ea-73af-4d7b-ad21-580f22f81181@192.168.203.43@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1790971648.873283:0:5834:0:(genops.c:1384:class_connect()) connect: client 7b6100ea-73af-4d7b-ad21-580f22f81181, cookie 0xbd3388eaa6f494fe 00000100:00080000:0.0:1790971648.873448:0:5834:0:(import.c:65:import_set_state_nolock()) ffff8cd4be195000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971648.873912:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+5:2353:x1877969745215872:12345-192.168.203.43@tcp:250: Request processed in 683us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971648.873922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:3.0:1790971648.885681:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971648.885769:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745215744 00000100:00100000:0.0:1790971648.885779:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745215744 00000100:00100000:0.0:1790971648.885844:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:0.0:1790971648.885854:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+5:5582:x1877969745215744:12345-192.168.203.43@tcp:101: 00010000:00010000:0.0:1790971648.885870:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971648.885887:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a1d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971648.885915:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971648.885926:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971648.885955:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc600, rc 0) 00000100:00100000:0.0:1790971648.886009:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+6:5582:x1877969745215744:12345-192.168.203.43@tcp:101: Request processed in 157us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971648.886016:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:3.0:1790971648.890944:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971648.892297:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216000 00000100:00100000:0.0:1790971648.892311:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216000 00000100:00100000:0.0:1790971648.892511:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:0.0:1790971648.892522:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+6:5582:x1877969745216000:12345-192.168.203.43@tcp:501: 00000100:00100000:0.0:1790971648.892837:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+6:5582:x1877969745216000:12345-192.168.203.43@tcp:501: Request processed in 316us (1900us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790971648.892846:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:3.0:1790971648.895790:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971648.895915:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216128 00000100:00100000:2.0:1790971648.895926:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216128 00000100:00100000:2.0:1790971648.895998:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:2.0:1790971648.896008:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+6:5582:x1877969745216128:12345-192.168.203.43@tcp:101: 00010000:00010000:2.0:1790971648.896025:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971648.896060:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a1dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971648.896104:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971648.896135:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971648.896144:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494935c00, rc 0) 00000100:00100000:2.0:1790971648.896202:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+7:5582:x1877969745216128:12345-192.168.203.43@tcp:101: Request processed in 195us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971648.896210:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:3.0:1790971648.902279:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971648.902668:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216256 00000100:00100000:0.0:1790971648.902682:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216256 00000100:00100000:0.0:1790971648.902757:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:0.0:1790971648.902768:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+7:5582:x1877969745216256:12345-192.168.203.43@tcp:501: 00000100:00100000:0.0:1790971648.903097:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5582:x1877969745216256:12345-192.168.203.43@tcp:501: Request processed in 331us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971648.903106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:3.0:1790971648.907759:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971648.908923:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216384 00000100:00100000:2.0:1790971648.908939:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216384 00000100:00100000:2.0:1790971648.909023:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:2.0:1790971648.909042:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5582:x1877969745216384:12345-192.168.203.43@tcp:503: 00000100:00100000:2.0:1790971648.909748:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5582:x1877969745216384:12345-192.168.203.43@tcp:503: Request processed in 706us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971648.909757:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:3.0:1790971648.912866:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971648.912998:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216512 00000100:00100000:2.0:1790971648.913014:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216512 00000100:00100000:2.0:1790971648.913203:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:2.0:1790971648.913338:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5601:x1877969745216512:12345-192.168.203.43@tcp:502: 00000100:00100000:2.0:1790971648.914043:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5601:x1877969745216512:12345-192.168.203.43@tcp:502: Request processed in 828us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971648.914052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:3.0:1790971648.954777:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971648.954939:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216640 00000100:00100000:0.0:1790971648.954959:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216640 00000100:00100000:0.0:1790971648.955183:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:0.0:1790971648.955195:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5601:x1877969745216640:12345-192.168.203.43@tcp:502: 00000100:00100000:1.0:1790971648.959256:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5601:x1877969745216640:12345-192.168.203.43@tcp:502: Request processed in 4051us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971648.959274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1790971648.969262:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971648.970595:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216768 00000100:00100000:2.0:1790971648.970608:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216768 00000100:00100000:2.0:1790971648.970677:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:2.0:1790971648.970687:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+8:5582:x1877969745216768:12345-192.168.203.43@tcp:101: 00010000:00010000:2.0:1790971648.970717:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971648.970737:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494935a00/0xbd3388eaa6f49513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a207 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971648.970771:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494935a00/0xbd3388eaa6f49513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a207 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971648.970784:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494935a00/0xbd3388eaa6f49513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a207 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971648.970794:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494935a00, rc 0) 00000100:00100000:2.0:1790971648.970860:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5582:x1877969745216768:12345-192.168.203.43@tcp:101: Request processed in 174us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971648.970868:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:2.0:1790971648.984656:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971648.984749:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745216896 00000100:00100000:1.0:1790971648.984760:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745216896 00000100:00100000:1.0:1790971648.984812:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:1.0:1790971648.984823:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5582:x1877969745216896:12345-192.168.203.43@tcp:256: 20000000:01000000:1.0:1790971648.984846:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790971648.984868:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790971648.984887:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790971648.984891:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790971648.984893:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1790971648.986905:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5582:x1877969745216896:12345-192.168.203.43@tcp:256: Request processed in 2077us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971648.986926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:3.0:1790971648.990900:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971648.991094:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217024 00000100:00100000:0.0:1790971648.991105:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217024 00000100:00100000:0.0:1790971648.991170:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:0.0:1790971648.991180:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5582:x1877969745217024:12345-192.168.203.43@tcp:101: 00010000:00010000:0.0:1790971648.991198:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971648.991216:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a20e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971648.991243:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971648.991256:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971648.991266:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc400, rc 0) 00000100:00100000:0.0:1790971648.991329:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5582:x1877969745217024:12345-192.168.203.43@tcp:101: Request processed in 150us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971648.991337:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:2.0:1790971648.994016:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971648.998211:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217152 00000100:00100000:1.0:1790971648.998227:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217152 00000100:00100000:1.0:1790971648.998295:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:1.0:1790971648.998305:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5582:x1877969745217152:12345-192.168.203.43@tcp:501: 00000100:00100000:1.0:1790971648.999238:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5582:x1877969745217152:12345-192.168.203.43@tcp:501: Request processed in 931us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971648.999249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1790971649.001426:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971649.001595:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217280 00000100:00100000:2.0:1790971649.001606:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217280 00000100:00100000:2.0:1790971649.001658:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:2.0:1790971649.001667:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5582:x1877969745217280:12345-192.168.203.43@tcp:503: 00000100:00100000:2.0:1790971649.002294:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5582:x1877969745217280:12345-192.168.203.43@tcp:503: Request processed in 626us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971649.002303:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:3.0:1790971649.007454:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971649.013499:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217408 00000100:00100000:1.0:1790971649.013515:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217408 00000100:00100000:1.0:1790971649.013638:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:1.0:1790971649.013649:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5606:x1877969745217408:12345-192.168.203.43@tcp:502: 00000100:00100000:1.0:1790971649.013977:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5606:x1877969745217408:12345-192.168.203.43@tcp:502: Request processed in 329us (6532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971649.013985:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:1.0:1790971649.023666:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971649.023766:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217536 00000100:00100000:0.0:1790971649.023777:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217536 00000100:00100000:0.0:1790971649.024363:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:0.0:1790971649.024375:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5606:x1877969745217536:12345-192.168.203.43@tcp:502: 00000100:00100000:0.0:1790971649.024722:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5606:x1877969745217536:12345-192.168.203.43@tcp:502: Request processed in 349us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971649.024732:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:3.0:1790971649.031042:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971649.031270:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217664 00000100:00100000:2.0:1790971649.031282:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217664 00000100:00100000:2.0:1790971649.031335:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:2.0:1790971649.031344:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1877969745217664:12345-192.168.203.43@tcp:38: 00010000:00080000:2.0:1790971649.031393:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:2.0:1790971649.031437:0:5840:0:(genops.c:1384:class_connect()) connect: client aa9b9adf-df76-49fe-88a5-1de8c4d3a597, cookie 0xbd3388eaa6f49521 00000004:00100000:2.0:1790971649.031466:0:5840:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790971649.031511:0:5840:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1790971649.066779:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8cd494dd7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790971649.066911:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2353:x1877969745217664:12345-192.168.203.43@tcp:38: Request processed in 35561us (35883us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971649.067153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00010000:00010000:2.0:1790971649.125348:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971650.075992:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971650.076039:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971650.076135:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217792 00000100:00100000:2.0:1790971650.076145:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217792 00000100:00100000:2.0:1790971650.076221:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745217920 00000100:00100000:2.0:1790971650.076224:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745217920 00000100:00100000:2.0:1790971650.076248:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1790971650.076257:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:0:x1877969745217792:12345-192.168.203.43@tcp:41: 00000004:00000024:2.0:1790971650.076298:0:5838:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790971650.076356:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:0:x1877969745217792:12345-192.168.203.43@tcp:41: Request processed in 100us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971650.076363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1790971650.076379:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1790971650.076384:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5582:x1877969745217920:12345-192.168.203.43@tcp:41: 00000004:00000024:2.0:1790971650.076393:0:5838:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790971650.076410:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5582:x1877969745217920:12345-192.168.203.43@tcp:41: Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971650.076415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00080000:0.0:1790971650.076494:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971650.086323:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971650.087169:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218048 00000100:00100000:2.0:1790971650.087193:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218048 00000100:00100000:2.0:1790971650.087258:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1790971650.087268:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5582:x1877969745218048:12345-192.168.203.43@tcp:40: 00000100:00100000:2.0:1790971650.087365:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5582:x1877969745218048:12345-192.168.203.43@tcp:40: Request processed in 98us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971650.087373:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1790971650.090411:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971650.090559:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971650.090674:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218560 00000100:00100000:0.0:1790971650.090691:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218560 00000100:00100000:0.0:1790971650.090769:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:0.0:1790971650.090780:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2354:x1877969745218560:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971650.091037:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218432 00000100:00100000:1.0:1790971650.091042:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218432 00000100:00100000:1.0:1790971650.091091:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1790971650.091099:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5582:x1877969745218432:12345-192.168.203.43@tcp:33: 00000100:00100000:0.0:1790971650.095608:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2354:x1877969745218560:12345-192.168.203.43@tcp:400: Request processed in 4815us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971650.095626:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:3.0:1790971650.095989:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971650.096174:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971650.097395:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218176 00000100:00100000:0.0:1790971650.097412:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218176 00000100:00100000:0.0:1790971650.097459:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218304 00000100:00100000:0.0:1790971650.097462:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218304 00000100:00100000:0.0:1790971650.097524:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1790971650.097532:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877969745218176:12345-192.168.203.43@tcp:8: 00010000:00080000:0.0:1790971650.097568:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1790971650.097603:0:6690:0:(genops.c:1384:class_connect()) connect: client aa9b9adf-df76-49fe-88a5-1de8c4d3a597, cookie 0xbd3388eaa6f49528 00002000:00100000:0.0:1790971650.097617:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa9b9adf-df76-49fe-88a5-1de8c4d3a597/ffff8cd4be197000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790971650.097644:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1790971650.098155:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1790971650.098162:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1877969745218304:12345-192.168.203.43@tcp:8: 00010000:00080000:1.0:1790971650.098192:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1790971650.098209:0:6689:0:(genops.c:1384:class_connect()) connect: client aa9b9adf-df76-49fe-88a5-1de8c4d3a597, cookie 0xbd3388eaa6f4952f 00002000:00100000:1.0:1790971650.098215:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa9b9adf-df76-49fe-88a5-1de8c4d3a597/ffff8cd4883ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790971650.098230:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790971650.098487:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790971650.098523:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cd4883eb000 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1790971650.104313:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790971650.104359:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cd4be196000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790971650.108795:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2353:x1877969745218304:12345-192.168.203.43@tcp:8: Request processed in 10616us (12605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971650.108813:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1790971650.108999:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2353:x1877969745218176:12345-192.168.203.43@tcp:8: Request processed in 11463us (13015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971650.109008:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000004:00080000:2.0:1790971650.126594:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 35428us 00000004:00200000:1.0:1790971650.141194:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790971650.141359:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5582:x1877969745218432:12345-192.168.203.43@tcp:33: Request processed in 50252us (50956us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971650.141370:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00010000:00010000:1.0:1790971650.149962:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971650.381169:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971650.381349:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218688 00000100:00100000:3.0:1790971650.381359:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218688 00000100:00100000:3.0:1790971650.381460:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1790971650.381494:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5623:x1877969745218688:12345-192.168.203.43@tcp:101: 00010000:00010000:3.0:1790971650.381514:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971650.381581:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a238 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971650.381646:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4953d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971650.381658:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4953d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971650.381671:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4953d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971650.381702:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790971650.381705:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971650.381723:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4953d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971650.381745:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a238 expref: 8 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971650.381775:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4953d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a238 expref: 7 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971650.381784:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971650.381786:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971650.381789:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d200, rc 0) 00000100:00100000:3.0:1790971650.381848:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:5623:x1877969745218688:12345-192.168.203.43@tcp:101: Request processed in 380us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971650.381856:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00010000:00010000:1.0:1790971651.174396:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971652.196763:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971652.520124:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971652.520226:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218816 00000100:00100000:2.0:1790971652.520238:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218816 00000100:00100000:2.0:1790971652.520318:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1790971652.520326:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:5676:x1877969745218816:12345-192.168.203.43@tcp:41: 00000004:00000024:2.0:1790971652.520366:0:5838:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790971652.520428:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:5676:x1877969745218816:12345-192.168.203.43@tcp:41: Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971652.520435:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00080000:0.0:1790971652.520567:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971652.528611:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971652.530190:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745218944 00000100:00100000:0.0:1790971652.530203:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745218944 00000100:00100000:0.0:1790971652.530285:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1790971652.530302:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5676:x1877969745218944:12345-192.168.203.43@tcp:13: 00002000:00000024:0.0:1790971652.530341:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971652.530415:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5676:x1877969745218944:12345-192.168.203.43@tcp:13: Request processed in 114us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971652.530437:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00080000:2.0:1790971652.533862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971652.537578:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971652.537791:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219072 00000100:00100000:0.0:1790971652.537804:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219072 00000100:00100000:0.0:1790971652.537901:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1790971652.537913:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5676:x1877969745219072:12345-192.168.203.43@tcp:13: 00002000:00000024:0.0:1790971652.537967:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790971652.538268:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971652.538606:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:5676:x1877969745219072:12345-192.168.203.43@tcp:13: Request processed in 691us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971652.538617:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1790971652.964832:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971652.964864:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766211456:0@lo:13: 00000100:00100000:0.0:1790971652.964943:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971652.965101:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211456 00000100:00100000:1.0:1790971652.965111:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211456 00000100:00100000:1.0:1790971652.965191:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790971652.965200:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766211456:12345-0@lo:13: 00002000:00000024:1.0:1790971652.965224:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971652.965267:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766211456:12345-0@lo:13: Request processed in 68us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971652.965275:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1790971652.965533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790971652.965563:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495acd500 x1877969766211456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971652.965582:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766211456:0@lo:13: 00010000:00010000:1.0:1790971653.220701:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971653.476686:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790971653.476711:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766211584:0@lo:13: 00000100:00100000:2.0:1790971653.476782:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971653.476785:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766211840:0@lo:400: 00000100:00100000:0.0:1790971653.476829:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971653.476854:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766211712:0@lo:400: 00000100:00100000:0.0:1790971653.476854:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766212352:0@lo:400: 00000100:00100000:3.0:1790971653.477203:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766212096:0@lo:400: 00000100:00100000:0.0:1790971653.478863:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971653.479380:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971653.479393:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766211968:0@lo:400: 00000100:00100000:0.0:1790971653.479430:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971653.479463:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212352 00000100:00100000:0.0:1790971653.479488:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212352 00000100:00100000:0.0:1790971653.479545:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971653.479554:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766212352:12345-0@lo:400: 00000100:00100000:0.0:1790971653.479609:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766212352:12345-0@lo:400: Request processed in 56us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971653.479616:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971653.479639:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211840 00000100:00100000:0.0:1790971653.479643:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211840 00000100:00100000:0.0:1790971653.479667:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211968 00000100:00100000:0.0:1790971653.479670:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211968 00000100:00100000:0.0:1790971653.479691:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790971653.479698:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766211840:12345-0@lo:400: 00000100:00100000:0.0:1790971653.479730:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766211840:12345-0@lo:400: Request processed in 33us (2903us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971653.479736:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790971653.479749:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790971653.479755:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766211968:12345-0@lo:400: 00000100:00100000:0.0:1790971653.479781:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766211968:12345-0@lo:400: Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971653.479786:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1790971653.479803:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971653.479807:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971653.480176:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971653.480216:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212096 00000100:00100000:0.0:1790971653.480220:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212096 00000100:00100000:0.0:1790971653.480412:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971653.480422:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766212096:12345-0@lo:400: 00000100:00100000:0.0:1790971653.480463:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766212096:12345-0@lo:400: Request processed in 43us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971653.480496:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790971653.480531:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c1ad2300 x1877969766212096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971653.480545:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766212096:0@lo:400: 00000100:00100000:0.0:1790971653.480577:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766211968:0@lo:400: 00000100:00100000:0.0:1790971653.480589:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766211840:0@lo:400: 00010000:00080000:0.0:1790971653.480601:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c1ad3b80 x1877969766212352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971653.480610:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766212352:0@lo:400: 00000100:00100000:2.0:1790971653.480793:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971653.480951:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766212224:0@lo:400: 00000100:00100000:2.0:1790971653.480986:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971653.481079:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211712 00000100:00100000:0.0:1790971653.481084:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211712 00000100:00100000:0.0:1790971653.481108:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790971653.481112:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766211712:12345-0@lo:400: 00000100:00100000:0.0:1790971653.481138:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766211712:12345-0@lo:400: Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971653.481253:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790971653.481457:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766211584 00000100:00100000:2.0:1790971653.481482:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766211584 00000100:00100000:2.0:1790971653.481508:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971653.481512:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766211584:12345-0@lo:13: 00002000:00000024:2.0:1790971653.481529:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971653.481566:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766211584:12345-0@lo:13: Request processed in 53us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971653.481572:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971653.481593:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212224 00000100:00100000:2.0:1790971653.481597:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212224 00000100:00100000:2.0:1790971653.481629:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790971653.481635:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766212224:12345-0@lo:400: 00000100:00100000:2.0:1790971653.481668:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766212224:12345-0@lo:400: Request processed in 33us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971653.481674:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790971653.481702:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971653.484466:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766211712:0@lo:400: 00000100:00100000:2.0:1790971653.484510:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766212224:0@lo:400: 00010000:00080000:2.0:1790971653.484525:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8dc00 x1877969766211584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971653.484544:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766211584:0@lo:13: 00000001:00100000:3.0:1790971653.532143:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000001:00100000:3.0:1790971653.547072:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00010000:00010000:1.0:1790971654.246540:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790971654.595727:0:5861:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00010000:00010000:2.0:1790971655.269265:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790971655.471352:0:8299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1790971655.591734:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971655.591783:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971655.591812:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971655.591842:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971655.591874:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219456 00000100:00100000:1.0:1790971655.591887:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219456 00000100:00100000:1.0:1790971655.591953:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219584 00000100:00100000:1.0:1790971655.591956:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219584 00000100:00100000:1.0:1790971655.591990:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1790971655.592002:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745219456:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971655.592107:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745219456:12345-192.168.203.43@tcp:400: Request processed in 106us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971655.592116:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1790971655.592143:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1790971655.592150:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745219584:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971655.592268:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745219584:12345-192.168.203.43@tcp:400: Request processed in 118us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971655.592275:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1790971655.592303:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219328 00000100:00100000:1.0:1790971655.592307:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219328 00000100:00100000:1.0:1790971655.592341:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:1.0:1790971655.592347:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745219328:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971655.592379:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745219328:12345-192.168.203.43@tcp:400: Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971655.592385:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00080000:1.0:1790971655.592423:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790971655.592429:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790971655.592431:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790971655.592908:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219200 00000100:00100000:3.0:1790971655.592914:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219200 00000100:00100000:3.0:1790971655.592984:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1790971655.592993:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745219200:12345-192.168.203.43@tcp:400: 00000100:00100000:3.0:1790971655.593071:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745219200:12345-192.168.203.43@tcp:400: Request processed in 79us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971655.593078:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00010000:00010000:0.0:1790971656.295365:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971657.317897:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971658.088554:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766212480:0@lo:13: 00000100:00100000:0.0:1790971658.088737:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971658.089938:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212480 00000100:00100000:3.0:1790971658.089952:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212480 00000100:00080000:0.0:1790971658.090033:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790971658.090073:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790971658.090091:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766212480:12345-0@lo:13: 00002000:00000024:3.0:1790971658.090144:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971658.093226:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766212480:12345-0@lo:13: Request processed in 3126us (4477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971658.093245:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790971658.112490:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf13800 x1877969766212480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971658.112531:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766212480:0@lo:13: 00010000:00010000:0.0:1790971658.342049:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971658.598135:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766212736:0@lo:400: 00000100:00100000:2.0:1790971658.598431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971658.598523:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766213248:0@lo:13: 00000100:00100000:2.0:1790971658.598570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971658.598773:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790971658.598781:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766212608:0@lo:400: 00000100:00100000:2.0:1790971658.598812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971658.598834:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766213120:0@lo:400: 00000100:00100000:2.0:1790971658.598856:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971658.598882:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212736 00000100:00100000:2.0:1790971658.598890:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212736 00000100:00100000:2.0:1790971658.598941:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790971658.598950:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766212736:12345-0@lo:400: 00000100:00100000:2.0:1790971658.599023:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766212736:12345-0@lo:400: Request processed in 73us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971658.599032:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790971658.599061:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766213248 00000100:00100000:2.0:1790971658.599064:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766213248 00000100:00100000:2.0:1790971658.599104:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790971658.599111:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766213248:12345-0@lo:13: 00002000:00000024:2.0:1790971658.599144:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971658.599178:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766213248:12345-0@lo:13: Request processed in 68us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971658.599185:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790971658.599203:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212608 00000100:00100000:2.0:1790971658.599206:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212608 00000100:00100000:2.0:1790971658.599230:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790971658.599236:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766212608:12345-0@lo:400: 00000100:00100000:2.0:1790971658.599267:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766212608:12345-0@lo:400: Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971658.599281:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790971658.599310:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766213120 00000100:00100000:2.0:1790971658.599314:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766213120 00000100:00100000:2.0:1790971658.599339:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790971658.599346:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766213120:12345-0@lo:400: 00000100:00100000:2.0:1790971658.599375:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766213120:12345-0@lo:400: Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971658.599382:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790971658.599408:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971658.599845:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766212864:0@lo:400: 00000100:00100000:0.0:1790971658.599881:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971658.599923:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971658.599930:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766212992:0@lo:400: 00000100:00100000:0.0:1790971658.599952:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971658.600090:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212864 00000100:00100000:1.0:1790971658.600096:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212864 00000100:00100000:1.0:1790971658.608974:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766212992 00000100:00100000:1.0:1790971658.608995:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766212992 00000100:00100000:1.0:1790971658.609112:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971658.609124:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766212864:12345-0@lo:400: 00000100:00100000:1.0:1790971658.609252:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766212864:12345-0@lo:400: Request processed in 130us (9369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971658.609260:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971658.609357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790971658.609365:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766212992:12345-0@lo:400: 00000100:00100000:1.0:1790971658.609399:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766212992:12345-0@lo:400: Request processed in 35us (9446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971658.609406:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790971658.609491:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766212992:0@lo:400: 00000100:00100000:1.0:1790971658.609579:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766212864:0@lo:400: 00000100:00100000:3.0:1790971658.610814:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766212608:0@lo:400: 00010000:00080000:3.0:1790971658.610844:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4883f0e00 x1877969766213120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971658.610856:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766213120:0@lo:400: 00000100:00100000:3.0:1790971658.610870:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766212736:0@lo:400: 00010000:00080000:3.0:1790971658.610880:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8dc00 x1877969766213248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971658.610898:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766213248:0@lo:13: 00000100:00080000:2.0:1790971658.615874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790971659.366691:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790971659.835265:0:8447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe245e31d0 20000000:00000080:0.0:1790971659.835359:0:8447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cd4b7090400 uarg=0000000000000000 20000000:01000000:0.0:1790971659.835418:0:8447:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1790971659.835420:0:8447:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1790971659.835424:0:8447:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790971659.835429:0:8447:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790971659.835436:0:8447:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1790971659.835457:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790971659.835459:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790971659.835795:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790971659.835799:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790971659.851857:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1790971659.853801:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1790971659.853900:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1790971659.854688:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1790971659.854721:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790971659.854725:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790971659.869767:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1790971659.870451:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1790971659.870559:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1790971659.870594:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1790971659.870607:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790971659.870610:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790971659.874564:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1790971659.875675:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1790971659.875747:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1790971659.875813:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1790971659.875830:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790971659.875834:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790971659.882568:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1790971659.884593:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1790971659.884663:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1790971659.884703:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1790971659.884721:0:8447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790971659.884749:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884783:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884792:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884800:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884807:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884814:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884821:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884827:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884853:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884861:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884869:0:8447:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884918:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.884937:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 9 pid: 5831 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.884954:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213376:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971659.885097:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885106:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 9 pid: 5832 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885115:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213504:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971659.885142:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885151:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 18 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885174:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213632:0@lo:104: 00000100:00100000:1.0:1790971659.885225:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790971659.885265:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885273:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 18 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885280:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213760:0@lo:104: 00000100:00100000:1.0:1790971659.885304:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790971659.885330:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885339:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 18 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885347:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213888:0@lo:104: 00010000:00010000:1.0:1790971659.885372:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885379:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 18 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885388:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214016:0@lo:104: 00010000:00010000:1.0:1790971659.885414:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885422:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 18 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885439:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214144:0@lo:104: 00010000:00010000:1.0:1790971659.885519:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885528:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 18 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885536:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214272:0@lo:104: 00010000:00010000:1.0:1790971659.885564:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971659.885571:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 18 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.885579:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214400:0@lo:104: 00000100:00100000:1.0:1790971659.885597:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971659.886130:0:5823:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790971659.886159:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971659.886179:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971659.886188:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971659.886198:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971659.886222:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971659.886236:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766213632 00000100:00100000:2.0:1790971659.886245:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766213632 00000100:00100000:2.0:1790971659.886294:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766213760 00000100:00100000:2.0:1790971659.886297:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766213760 00000100:00100000:2.0:1790971659.886308:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766213888 00000100:00100000:2.0:1790971659.886310:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766213888 00000100:00100000:2.0:1790971659.886319:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214016 00000100:00100000:2.0:1790971659.886321:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214016 00000100:00100000:2.0:1790971659.886329:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214144 00000100:00100000:2.0:1790971659.886332:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214144 00000100:00100000:2.0:1790971659.886340:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214272 00000100:00100000:2.0:1790971659.886342:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214272 00000100:00100000:2.0:1790971659.886352:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214400 00000100:00100000:2.0:1790971659.886361:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214400 00000100:00100000:2.0:1790971659.886380:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790971659.886390:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+9:8447:x1877969766213632:12345-0@lo:104: 00010000:00010000:2.0:1790971659.886407:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.886490:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790971659.886497:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+9:8447:x1877969766213632:12345-0@lo:104: Request processed in 108us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.886505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790971659.886526:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790971659.886532:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1acb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+8:8447:x1877969766213760:12345-0@lo:104: 00010000:00010000:2.0:1790971659.886540:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.886588:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790971659.886594:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1acb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+8:8447:x1877969766213760:12345-0@lo:104: Request processed in 63us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.886600:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790971659.886637:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790971659.886644:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+7:8447:x1877969766213888:12345-0@lo:104: 00010000:00010000:2.0:1790971659.886651:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.886683:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790971659.886688:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+7:8447:x1877969766213888:12345-0@lo:104: Request processed in 46us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.886694:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790971659.886715:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790971659.886720:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+6:8447:x1877969766214016:12345-0@lo:104: 00010000:00010000:2.0:1790971659.886729:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.886757:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790971659.886763:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+6:8447:x1877969766214016:12345-0@lo:104: Request processed in 43us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.886781:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790971659.886793:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790971659.886800:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+5:8447:x1877969766214144:12345-0@lo:104: 00010000:00010000:2.0:1790971659.886807:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.886835:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790971659.886840:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+5:8447:x1877969766214144:12345-0@lo:104: Request processed in 42us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.886845:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790971659.886857:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790971659.886862:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:8447:x1877969766214272:12345-0@lo:104: 00010000:00010000:2.0:1790971659.886869:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.886896:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1790971659.886900:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:8447:x1877969766214272:12345-0@lo:104: Request processed in 39us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.886906:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790971659.886925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790971659.886931:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:8447:x1877969766214400:12345-0@lo:104: 00010000:00010000:2.0:1790971659.886939:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887142:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1790971659.887147:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:8447:x1877969766214400:12345-0@lo:104: Request processed in 216us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.887153:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790971659.887178:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790971659.887184:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887192:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbde00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971659.887197:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887207:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971659.887214:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971659.887220:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790971659.887259:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887265:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971659.887288:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887306:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbde00/0xbd3388eaa6f494f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887323:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790971659.887326:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887332:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971659.887335:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887342:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971659.887349:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971659.887354:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790971659.887367:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887373:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971659.887378:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887385:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f494c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887393:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790971659.887401:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887407:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43a00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971659.887410:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887417:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971659.887423:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971659.887429:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790971659.887441:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887446:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971659.887464:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887495:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43a00/0xbd3388eaa6f494aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887506:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790971659.887509:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887514:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c600 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971659.887517:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887534:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971659.887541:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971659.887547:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790971659.887561:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.887566:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971659.887689:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790971659.887696:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887704:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42c00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971659.887707:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887714:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971659.887722:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971659.887739:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971659.887755:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887761:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971659.887776:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887783:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42c00/0xbd3388eaa6f4948e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49495 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887795:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790971659.887798:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887803:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971659.887806:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887813:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971659.887820:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971659.887825:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971659.887837:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887842:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971659.887853:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887859:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd43600/0xbd3388eaa6f49464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4946b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887868:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971659.887871:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887877:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971659.887879:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887886:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971659.887892:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971659.887896:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971659.887908:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887913:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971659.887917:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887924:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42400/0xbd3388eaa6f4943a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49441 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.887933:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971659.887941:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971659.887955:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971659.887999:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766214656:0@lo:103: 00000100:00100000:0.0:1790971659.888057:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971659.888102:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766215168:0@lo:103: 00000100:00100000:0.0:1790971659.888124:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971659.888147:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790971659.888154:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766214528:0@lo:103: 00000100:00100000:0.0:1790971659.888174:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971659.888190:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766215040:0@lo:103: 00000100:00100000:0.0:1790971659.888209:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971659.888238:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766214784:0@lo:103: 00000100:00100000:0.0:1790971659.888261:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971659.888271:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766215296:0@lo:103: 00000100:00100000:0.0:1790971659.888290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971659.888300:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971659.888305:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766214912:0@lo:103: 00000100:00100000:0.0:1790971659.888329:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971659.888351:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214656 00000100:00100000:0.0:1790971659.888359:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214656 00010000:00010000:0.0:1790971659.888394:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 19 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971659.888415:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215168 00000100:00100000:0.0:1790971659.888418:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215168 00010000:00010000:0.0:1790971659.888430:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 20 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971659.888454:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214528 00000100:00100000:0.0:1790971659.888457:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214528 00010000:00010000:0.0:1790971659.888501:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 21 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971659.888512:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215040 00000100:00100000:0.0:1790971659.888514:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215040 00010000:00010000:0.0:1790971659.888525:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 22 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971659.888534:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214784 00000100:00100000:0.0:1790971659.888536:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214784 00010000:00010000:0.0:1790971659.888544:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 23 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971659.888553:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215296 00000100:00100000:0.0:1790971659.888556:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215296 00010000:00010000:0.0:1790971659.888565:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 24 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971659.888821:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766214912 00000100:00100000:0.0:1790971659.888825:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766214912 00010000:00010000:0.0:1790971659.888839:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 25 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971659.888851:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790971659.888859:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+25:3303:x1877969766214656:12345-0@lo:103: 00010000:00010000:0.0:1790971659.888874:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971659.888879:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 25 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.888901:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 25 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.888937:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971659.889049:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+25:3303:x1877969766214656:12345-0@lo:103: Request processed in 189us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971659.889056:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790971659.889077:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790971659.889083:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+24:3303:x1877969766215168:12345-0@lo:103: 00010000:00010000:0.0:1790971659.889092:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971659.889097:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 24 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889105:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 24 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889115:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971659.889138:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+24:3303:x1877969766215168:12345-0@lo:103: Request processed in 55us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971659.889145:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790971659.889157:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790971659.889163:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+23:3303:x1877969766214528:12345-0@lo:103: 00010000:00010000:0.0:1790971659.889171:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971659.889176:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 23 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889184:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 23 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889201:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971659.889226:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+23:3303:x1877969766214528:12345-0@lo:103: Request processed in 62us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971659.889233:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790971659.889246:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790971659.889252:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+22:3303:x1877969766215040:12345-0@lo:103: 00010000:00010000:0.0:1790971659.889259:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971659.889264:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 22 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889272:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 22 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889281:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971659.889303:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+22:3303:x1877969766215040:12345-0@lo:103: Request processed in 52us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971659.889309:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790971659.889322:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790971659.889329:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+21:3304:x1877969766214784:12345-0@lo:103: 00010000:00010000:0.0:1790971659.889337:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971659.889342:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 21 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889351:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 21 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889361:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971659.889397:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+21:3304:x1877969766214784:12345-0@lo:103: Request processed in 69us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971659.889404:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790971659.889417:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790971659.889423:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+20:3304:x1877969766215296:12345-0@lo:103: 00010000:00010000:0.0:1790971659.889430:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971659.889435:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 20 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889442:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 20 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889451:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971659.889506:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+20:3304:x1877969766215296:12345-0@lo:103: Request processed in 83us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971659.889512:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790971659.889524:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790971659.889530:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b5252050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766214912:12345-0@lo:103: 00010000:00010000:0.0:1790971659.889540:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971659.889543:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 19 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889552:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 19 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971659.889562:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971659.889711:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.889725:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c600/0xbd3388eaa6f4949c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f494a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.889752:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971659.889754:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971659.889757:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971659.889931:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971659.890432:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbd000/0xbd3388eaa6f494f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f494f0 expref: 19 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.890449:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213632:0@lo:104: 00010000:00010000:1.0:1790971659.890464:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494935200/0xbd3388eaa6f494cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f494c6 expref: 18 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.890534:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213760:0@lo:104: 00010000:00010000:1.0:1790971659.890548:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002d000/0xbd3388eaa6f494b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f494aa expref: 17 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.890559:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213888:0@lo:104: 00000100:00100000:0.0:1790971659.890751:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b5252050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3304:x1877969766214912:12345-0@lo:103: Request processed in 1218us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971659.890760:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790971659.891125:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766214528:0@lo:103: 00000100:00100000:3.0:1790971659.891137:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766215040:0@lo:103: 00000100:00100000:3.0:1790971659.891148:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766214656:0@lo:103: 00000100:00100000:3.0:1790971659.891156:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766215168:0@lo:103: 00010000:00010000:3.0:1790971659.893890:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f494a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4949c expref: 15 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971659.893911:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214016:0@lo:104: 00010000:00010000:3.0:1790971659.893924:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002da00/0xbd3388eaa6f49495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4948e expref: 14 pid: 5832 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971659.893967:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214144:0@lo:104: 00010000:00010000:3.0:1790971659.893983:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f4946b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49464 expref: 13 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971659.894001:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214272:0@lo:104: 00010000:00010000:3.0:1790971659.894013:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f49441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4943a expref: 12 pid: 5831 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971659.894023:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766214400:0@lo:104: 00000100:00100000:0.0:1790971659.894123:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766214912:0@lo:103: 00000100:00100000:0.0:1790971659.894139:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766214784:0@lo:103: 00000100:00100000:0.0:1790971659.894149:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766215296:0@lo:103: 00000100:00100000:1.0:1790971659.909236:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971659.909604:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219712 00000100:00100000:2.0:1790971659.909617:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219712 00010000:00010000:2.0:1790971659.909686:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 10 pid: 5831 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971659.909734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971659.909744:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745219712:12345-192.168.203.43@tcp:103: 00010000:00010000:2.0:1790971659.909763:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971659.909783:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 10 pid: 5831 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.909799:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 10 pid: 5831 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.909825:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971659.909902:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745219712:12345-192.168.203.43@tcp:103: Request processed in 159us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.909911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00010000:00010000:3.0:1790971659.914198:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494935c00/0xbd3388eaa6f4950c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1dd expref: 9 pid: 5831 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971659.914235:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213376:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971659.925405:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1877969766213504:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971659.925506:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971659.927052:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971659.932643:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219840 00000100:00100000:3.0:1790971659.932664:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219840 00010000:00010000:2.0:1790971659.932829:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 9 pid: 5832 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971659.932880:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1790971659.932891:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+9:2356:x1877969745219840:12345-192.168.203.43@tcp:103: 00010000:00010000:2.0:1790971659.932913:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971659.932919:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 9 pid: 5832 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.932935:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 9 pid: 5832 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.932959:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a1d6 expref: 9 pid: 5832 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.932980:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933002:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933203:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933213:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933221:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933228:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933236:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971659.933241:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933250:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971659.933429:0:8447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971659.933439:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933702:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933712:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f49544 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971659.933730:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971659.934386:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+8:2356:x1877969745219840:12345-192.168.203.43@tcp:103: Request processed in 1488us (9115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971659.934397:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:0.0:1790971660.388795:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971660.710753:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971660.710803:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971660.710835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971660.710865:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971660.710899:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220096 00000100:00100000:1.0:1790971660.710911:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220096 00000100:00100000:1.0:1790971660.711008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1790971660.711020:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745220096:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971660.711124:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745220096:12345-192.168.203.43@tcp:400: Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971660.711133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1790971660.711168:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220224 00000100:00100000:1.0:1790971660.711171:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220224 00000100:00100000:1.0:1790971660.711203:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220352 00000100:00100000:1.0:1790971660.711206:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220352 00000100:00100000:1.0:1790971660.711229:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971660.711235:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745220224:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971660.711264:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745220224:12345-192.168.203.43@tcp:400: Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971660.711271:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971660.711283:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1790971660.711290:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745220352:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971660.711315:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745220352:12345-192.168.203.43@tcp:400: Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971660.711345:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1790971660.711684:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745219968 00000100:00100000:0.0:1790971660.711690:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745219968 00000100:00100000:0.0:1790971660.711726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:0.0:1790971660.711734:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+8:2357:x1877969745219968:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1790971660.711765:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+8:2357:x1877969745219968:12345-192.168.203.43@tcp:400: Request processed in 32us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971660.711772:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00080000:2.0:1790971660.712788:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790971660.712811:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790971660.712816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790971661.415810:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790971661.540639:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790971661.540653:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4bfbb1000 from 39 10000000:01000000:0.0:1790971661.540661:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790971661.540729:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.540744:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.540758:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971661.540814:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766215424:0@lo:101: 00000100:00100000:0.0:1790971661.540916:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.541025:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488a58300 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.541676:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215424 00000100:00100000:2.0:1790971661.541688:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215424 00000100:00100000:2.0:1790971661.541778:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790971661.541882:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+12:5836:x1877969766215424:12345-0@lo:101: 00010000:00010000:2.0:1790971661.541903:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971661.541924:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd487d58400/0xbd3388eaa6f49552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4954b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.541969:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d58400/0xbd3388eaa6f49552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4954b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.541990:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd487d58400/0xbd3388eaa6f49552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4954b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.542441:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58400, rc 0) 00000100:00100000:2.0:1790971661.543146:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766215424:12345-0@lo:101: Request processed in 1353us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.543158:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790971661.548241:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766215424:0@lo:101: 00010000:00010000:1.0:1790971661.548499:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.548516:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971661.548632:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766215552:0@lo:501: 00000100:00100000:1.0:1790971661.548717:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.548950:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.554356:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215552 00000100:00100000:0.0:1790971661.554404:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215552 00000100:00100000:0.0:1790971661.554519:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790971661.554531:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766215552:12345-0@lo:501: 00000100:00100000:0.0:1790971661.556108:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766215552:12345-0@lo:501: Request processed in 1570us (7382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.556124:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790971661.557019:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766215552:0@lo:501: 00000100:00100000:1.0:1790971661.557096:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766215680:0@lo:503: 00000100:00100000:1.0:1790971661.557180:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.557233:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.557633:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215680 00000100:00100000:2.0:1790971661.557642:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215680 00000100:00100000:2.0:1790971661.557712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790971661.557723:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766215680:12345-0@lo:503: 00000100:00100000:2.0:1790971661.558037:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766215680:12345-0@lo:503: Request processed in 314us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.558045:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790971661.558848:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766215680:0@lo:503: 00000100:00100000:3.0:1790971661.567905:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8463:1877969766215808:0@lo:502: 00000100:00100000:3.0:1790971661.568060:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971661.568127:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec840 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.568935:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215808 00000100:00100000:0.0:1790971661.568949:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215808 00000100:00100000:0.0:1790971661.569039:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790971661.569050:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:8463:x1877969766215808:12345-0@lo:502: 00000100:00100000:0.0:1790971661.569405:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+13:8463:x1877969766215808:12345-0@lo:502: Request processed in 354us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.569415:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790971661.570558:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8463:1877969766215808:0@lo:502: 00000100:00100000:3.0:1790971661.570670:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8463:1877969766215936:0@lo:502: 00000100:00100000:3.0:1790971661.570743:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.571018:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766215936 00000100:00100000:0.0:1790971661.571027:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766215936 00000100:00100000:0.0:1790971661.571086:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790971661.571095:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:8463:x1877969766215936:12345-0@lo:502: 00000100:00100000:0.0:1790971661.571373:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+13:8463:x1877969766215936:12345-0@lo:502: Request processed in 278us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.571382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790971661.571755:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec840 going to sleep for 11 seconds 00000100:00100000:3.0:1790971661.571856:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8463:1877969766215936:0@lo:502: 00000040:00080000:3.0:1790971661.571893:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790971661.587683:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790971661.587736:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790971661.587752:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.587768:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971661.587961:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1790971661.587965:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1790971661.587969:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790971661.588034:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.588060:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.588074:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971661.588102:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216064:0@lo:101: 00000100:00100000:1.0:1790971661.588195:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.588326:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.597340:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216064 00000100:00100000:2.0:1790971661.597389:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216064 00000100:00100000:2.0:1790971661.597497:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790971661.597509:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+13:5836:x1877969766216064:12345-0@lo:101: 00010000:00010000:2.0:1790971661.597532:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971661.597559:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd487d58200/0xbd3388eaa6f49560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49559 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.597595:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d58200/0xbd3388eaa6f49560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49559 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.597609:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd487d58200/0xbd3388eaa6f49560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49559 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.597620:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58200, rc 0) 00000100:00100000:2.0:1790971661.598152:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766216064:12345-0@lo:101: Request processed in 644us (9955us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.598161:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790971661.603761:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216064:0@lo:101: 00010000:00010000:1.0:1790971661.603876:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.603892:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971661.604199:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216192:0@lo:501: 00000100:00100000:1.0:1790971661.604283:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.604400:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.623114:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216192 00000100:00100000:2.0:1790971661.623137:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216192 00000100:00100000:2.0:1790971661.623212:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790971661.623223:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766216192:12345-0@lo:501: 00000100:00100000:2.0:1790971661.623952:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766216192:12345-0@lo:501: Request processed in 726us (19664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.623983:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790971661.633912:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216192:0@lo:501: 00000100:00100000:0.0:1790971661.634151:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216320:0@lo:503: 00000100:00100000:0.0:1790971661.634275:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.634332:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488a58300 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.638514:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216320 00000100:00100000:2.0:1790971661.638542:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216320 00000100:00100000:2.0:1790971661.638642:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790971661.638653:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766216320:12345-0@lo:503: 00000100:00100000:2.0:1790971661.639052:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766216320:12345-0@lo:503: Request processed in 398us (4775us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.639070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790971661.639378:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf12a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216320:0@lo:503: 00000100:00100000:3.0:1790971661.640608:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8464:1877969766216448:0@lo:502: 00000100:00100000:3.0:1790971661.640716:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971661.640775:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec840 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.640895:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216448 00000100:00100000:0.0:1790971661.640905:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216448 00000100:00100000:0.0:1790971661.640971:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790971661.640988:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8464:x1877969766216448:12345-0@lo:502: 00000100:00100000:0.0:1790971661.641260:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8464:x1877969766216448:12345-0@lo:502: Request processed in 273us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.641269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790971661.642887:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8464:1877969766216448:0@lo:502: 00000020:01000000:1.0:1790971661.642945:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971661.642969:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971661.642972:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790971661.642986:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790971661.643036:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8464:1877969766216576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.643122:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.643175:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.643423:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216576 00000100:00100000:2.0:1790971661.643432:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216576 00000100:00100000:2.0:1790971661.643527:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790971661.643538:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8464:x1877969766216576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971661.643801:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:8464:x1877969766216576:12345-0@lo:502:llog_process_th.0 Request processed in 263us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.643810:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790971661.644141:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8464:1877969766216576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790971661.644168:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971661.644177:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971661.644179:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790971661.644184:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790971661.644497:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790971661.644523:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790971661.644536:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971661.644551:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971661.644562:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790971661.644565:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4be529000 from 39 10000000:01000000:3.0:1790971661.644568:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790971661.644606:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971661.644614:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971661.644646:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971661.644670:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790971661.644719:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971661.644759:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feecd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.645182:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216704 00000100:00100000:0.0:1790971661.645191:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216704 00000100:00100000:0.0:1790971661.645247:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790971661.645258:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:5836:x1877969766216704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971661.645274:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971661.645291:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbd200/0xbd3388eaa6f4956e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49567 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.645320:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbd200/0xbd3388eaa6f4956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49567 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.645331:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbd200/0xbd3388eaa6f4956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49567 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.645340:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd200, rc 0) 00000100:00100000:0.0:1790971661.645393:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766216704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.645400:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790971661.645661:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971661.645678:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.645688:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971661.645753:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.645783:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.645803:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971661.646058:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216832 00000100:00100000:3.0:1790971661.646064:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216832 00000100:00100000:3.0:1790971661.646099:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790971661.646106:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766216832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971661.646444:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766216832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971661.646452:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790971661.647439:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.647522:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.647598:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.648362:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.648446:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766216960 00000100:00100000:0.0:1790971661.648455:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766216960 00000100:00100000:0.0:1790971661.648549:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790971661.648558:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766216960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.648839:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766216960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.648847:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790971661.649113:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766216960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.649377:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8465:1877969766217088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.649425:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.649451:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790971661.649691:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217088 00000100:00100000:3.0:1790971661.649912:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217088 00000100:00100000:3.0:1790971661.649950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790971661.649966:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8465:x1877969766217088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971661.650267:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8465:x1877969766217088:12345-0@lo:502:llog_process_th.0 Request processed in 308us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971661.650276:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790971661.650924:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8465:1877969766217088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.651020:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8465:1877969766217216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.651079:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.651119:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790971661.651212:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217216 00000100:00100000:3.0:1790971661.651219:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217216 00000100:00100000:3.0:1790971661.651266:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790971661.651275:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8465:x1877969766217216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971661.651529:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+15:8465:x1877969766217216:12345-0@lo:502:llog_process_th.0 Request processed in 254us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971661.651544:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790971661.651751:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8465:1877969766217216:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790971661.651774:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790971661.651968:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790971661.651999:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790971661.652012:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.652024:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971661.652035:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790971661.652038:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1790971661.652041:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790971661.652081:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.652089:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.652099:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971661.652117:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790971661.652162:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971661.652187:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.652247:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217344 00000100:00100000:0.0:1790971661.652253:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217344 00000100:00100000:0.0:1790971661.652291:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790971661.652300:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+15:5836:x1877969766217344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971661.652311:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971661.652326:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f4957c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49575 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.652353:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f4957c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49575 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.652365:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f4957c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49575 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.652376:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc000, rc 0) 00000100:00100000:0.0:1790971661.652419:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766217344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.652426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790971661.652509:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971661.652524:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.652534:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971661.652588:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971661.652614:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971661.652647:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.652796:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217472 00000100:00100000:0.0:1790971661.652801:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217472 00000100:00100000:0.0:1790971661.652827:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790971661.652833:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766217472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.653138:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766217472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.653146:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790971661.657563:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971661.657668:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971661.657780:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971661.657825:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.658054:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217600 00000100:00100000:0.0:1790971661.658065:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217600 00000100:00100000:0.0:1790971661.658127:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790971661.658137:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766217600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.658398:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766217600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.658409:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790971661.662244:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971661.667350:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8466:1877969766217728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971661.667517:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971661.667571:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1790971661.668029:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217728 00000100:00100000:1.0:1790971661.668041:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217728 00000100:00100000:1.0:1790971661.668100:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790971661.668111:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8466:x1877969766217728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.668511:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8466:x1877969766217728:12345-0@lo:502:llog_process_th.0 Request processed in 399us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971661.668520:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790971661.668840:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8466:1877969766217728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971661.668882:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971661.668894:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971661.668897:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790971661.668905:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790971661.668948:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8466:1877969766217856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971661.669011:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971661.669049:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feecf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.669104:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217856 00000100:00100000:2.0:1790971661.669110:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217856 00000100:00100000:2.0:1790971661.669155:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790971661.669162:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8466:x1877969766217856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971661.669337:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:8466:x1877969766217856:12345-0@lo:502:llog_process_th.0 Request processed in 174us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.669352:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790971661.669520:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8466:1877969766217856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971661.669545:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971661.669551:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971661.669552:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790971661.669557:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1790971661.669761:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1790971661.669786:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790971661.669799:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.669814:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971661.669826:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790971661.669830:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4b52bc800 from 39 10000000:01000000:2.0:1790971661.669833:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790971661.669868:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.669878:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.669889:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971661.669907:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790971661.669942:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971661.669991:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.670053:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766217984 00000100:00100000:0.0:1790971661.670059:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766217984 00000100:00100000:0.0:1790971661.670104:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790971661.670112:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766217984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971661.670124:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971661.670140:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f4958a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49583 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.670168:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f4958a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49583 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.670180:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f4958a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49583 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.670190:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc200, rc 0) 00000100:00100000:0.0:1790971661.670239:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766217984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.670245:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790971661.670354:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766217984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971661.670369:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971661.670378:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971661.670427:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971661.670452:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971661.670497:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.670545:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766218112 00000100:00100000:0.0:1790971661.670550:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766218112 00000100:00100000:0.0:1790971661.670567:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790971661.670573:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766218112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.670863:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766218112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.670881:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790971661.672521:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971661.672616:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971661.672733:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971661.672785:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971661.672915:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766218240 00000100:00100000:1.0:1790971661.672925:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766218240 00000100:00100000:1.0:1790971661.673000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790971661.673011:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766218240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.673293:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766218240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971661.673301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790971661.674294:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971661.675987:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8467:1877969766218368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971661.676091:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971661.676144:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feecc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971661.678601:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766218368 00000100:00100000:1.0:1790971661.678623:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766218368 00000100:00100000:1.0:1790971661.678716:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790971661.678727:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8467:x1877969766218368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.679154:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8467:x1877969766218368:12345-0@lo:502:llog_process_th.0 Request processed in 428us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971661.679171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790971661.679713:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8467:1877969766218368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971661.679817:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8467:1877969766218496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971661.679889:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971661.679951:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.680186:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766218496 00000100:00100000:0.0:1790971661.680194:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766218496 00000100:00100000:0.0:1790971661.680237:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790971661.680246:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8467:x1877969766218496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971661.680534:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8467:x1877969766218496:12345-0@lo:502:llog_process_th.0 Request processed in 289us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.680542:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790971661.680629:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8467:1877969766218496:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790971661.680653:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790971661.690285:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790971661.690333:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790971661.690350:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.690366:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971661.690379:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790971661.690382:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790971661.690386:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790971661.690447:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.690458:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.690489:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971661.690521:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.690637:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.690680:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957b3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.690765:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766218624 00000100:00100000:2.0:1790971661.690775:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766218624 00000100:00100000:2.0:1790971661.690837:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790971661.690848:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766218624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971661.690866:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971661.690881:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd487d58c00/0xbd3388eaa6f49598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49591 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.690910:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d58c00/0xbd3388eaa6f49598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49591 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.690921:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd487d58c00/0xbd3388eaa6f49598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49591 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971661.690931:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58c00, rc 0) 00000100:00100000:2.0:1790971661.690991:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766218624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971661.690999:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790971661.694354:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971661.694397:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.694412:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971661.694574:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.694656:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.694703:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971661.694816:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766218752 00000100:00100000:1.0:1790971661.694825:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766218752 00000100:00100000:1.0:1790971661.694882:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790971661.694893:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766218752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.695302:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766218752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 409us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971661.695549:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790971661.695655:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.695702:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.695754:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.695850:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971661.695889:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766218880 00000100:00100000:1.0:1790971661.695895:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766218880 00000100:00100000:1.0:1790971661.695953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790971661.695961:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766218880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.696188:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766218880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971661.696196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790971661.696208:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766218880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971661.697127:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8468:1877969766219008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.697198:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.697241:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.697307:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219008 00000100:00100000:0.0:1790971661.697315:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219008 00000100:00100000:0.0:1790971661.697360:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790971661.697369:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8468:x1877969766219008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971661.697670:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8468:x1877969766219008:12345-0@lo:502:llog_process_th.0 Request processed in 301us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.697679:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790971661.697811:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8468:1877969766219008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790971661.697845:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971661.697857:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971661.697860:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790971661.697867:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790971661.697892:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8468:1877969766219136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971661.697933:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971661.697967:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486556000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971661.698087:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219136 00000100:00100000:0.0:1790971661.698093:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219136 00000100:00100000:0.0:1790971661.698130:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790971661.698144:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8468:x1877969766219136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971661.698296:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8468:x1877969766219136:12345-0@lo:502:llog_process_th.0 Request processed in 153us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971661.698304:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790971661.710103:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8468:1877969766219136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971661.710176:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971661.710190:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971661.710193:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790971661.710200:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790971661.710984:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1790971661.711021:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790971661.711036:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.711061:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971661.711074:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790971661.711078:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cd48794cd40 from 1 10000000:01000000:0.0:1790971661.711081:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790971661.711133:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.711142:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.711152:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971661.711183:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766219264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.711270:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.711331:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957b3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971661.711413:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219264 00000100:00100000:1.0:1790971661.711423:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219264 00000100:00100000:1.0:1790971661.711517:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790971661.711528:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766219264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971661.711545:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971661.711561:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43000/0xbd3388eaa6f495a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4959f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.711591:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43000/0xbd3388eaa6f495a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4959f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.711604:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43000/0xbd3388eaa6f495a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4959f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971661.711616:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43000, rc 0) 00000100:00100000:1.0:1790971661.711671:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766219264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971661.711679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790971661.712453:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766219264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971661.712524:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971661.712534:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f495a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971661.712648:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766219392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971661.712694:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971661.712733:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790971661.713146:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219392 00000100:00100000:2.0:1790971661.713153:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219392 00000100:00100000:2.0:1790971661.713194:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790971661.713204:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766219392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971661.713569:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766219392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (873us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790971661.713577:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790971661.714394:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766219392:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1790971661.714450:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790971661.714463:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971661.714502:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971662.436882:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971663.205011:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971663.205041:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766219520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971663.205155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971663.205983:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219520 00000100:00100000:0.0:1790971663.206004:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219520 00000100:00100000:0.0:1790971663.206102:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790971663.206113:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766219520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971663.206176:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971663.206256:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766219520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971663.206264:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790971663.206319:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf11c00 x1877969766219520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971663.206342:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766219520:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971663.206757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790971663.461433:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971663.721363:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766219904:0@lo:400:kworker.0 00000100:00100000:0.0:1790971663.721456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971663.721559:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971663.721567:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766220032:0@lo:400:kworker.0 00000100:00100000:0.0:1790971663.721591:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971663.721649:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219904 00000100:00100000:0.0:1790971663.721659:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219904 00000100:00100000:0.0:1790971663.721713:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766220032 00000100:00100000:0.0:1790971663.721717:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766220032 00000100:00100000:0.0:1790971663.721741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790971663.721751:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766219904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971663.721816:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766219904:12345-0@lo:400:kworker.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971663.721824:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790971663.721843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790971663.721849:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766220032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971663.721877:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766220032:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971663.721883:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790971663.721926:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766220032:0@lo:400:kworker.0 00000100:00100000:0.0:1790971663.721937:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766219904:0@lo:400:kworker.0 00000100:00100000:3.0:1790971663.722597:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766219648:0@lo:400:kworker.0 00000100:00100000:3.0:1790971663.722648:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971663.722692:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766220160:0@lo:400:kworker.0 00000100:00100000:3.0:1790971663.722723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971663.722756:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971663.722764:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766219776:0@lo:400:kworker.0 00000100:00100000:3.0:1790971663.722789:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790971663.722822:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971663.722836:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219776 00000100:00100000:3.0:1790971663.722842:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219776 00000100:00100000:3.0:1790971663.722870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790971663.722878:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766219776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971663.722925:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766219776:12345-0@lo:400:kworker.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971663.722932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790971663.722979:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766219776:0@lo:400:kworker.0 00000100:00100000:1.0:1790971663.724129:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766220160 00000100:00100000:1.0:1790971663.724142:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766220160 00000100:00100000:1.0:1790971663.724199:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790971663.724212:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766220160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971663.724291:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766220160:12345-0@lo:400:kworker.0 Request processed in 79us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971663.724300:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790971663.727803:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766219648 00000100:00100000:0.0:1790971663.727819:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766219648 00000100:00100000:0.0:1790971663.727894:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790971663.727905:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766219648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971663.728030:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766219648:12345-0@lo:400:kworker.0 Request processed in 126us (5380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971663.728037:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1790971663.728204:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971663.728256:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766219648:0@lo:400:kworker.0 00010000:00080000:3.0:1790971663.728278:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf13480 x1877969766220160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971663.728292:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766220160:0@lo:400:kworker.0 00000100:00100000:3.0:1790971663.728321:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971663.728334:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766220288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971663.728376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971663.728433:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766220288 00000100:00100000:3.0:1790971663.728437:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766220288 00000100:00100000:3.0:1790971663.729899:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790971663.731398:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766220288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971663.731463:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971663.731597:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766220288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1683us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971663.731625:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790971663.733727:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0fce00 x1877969766220288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971663.733763:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766220288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790971664.484750:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971665.509331:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971665.836011:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971665.836061:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971665.836266:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971665.836300:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971665.836331:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971665.836368:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220864 00000100:00100000:1.0:1790971665.836380:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220864 00000100:00100000:1.0:1790971665.836452:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220992 00000100:00100000:1.0:1790971665.836456:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220992 00000100:00100000:3.0:1790971665.836519:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1790971665.836533:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745220864:12345-192.168.203.43@tcp:400: 00000100:00100000:3.0:1790971665.836632:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745220864:12345-192.168.203.43@tcp:400: Request processed in 102us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971665.836656:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1790971665.836695:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220736 00000100:00100000:3.0:1790971665.836699:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220736 00000100:00100000:3.0:1790971665.836748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:3.0:1790971665.836755:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745220736:12345-192.168.203.43@tcp:400: 00000100:00100000:3.0:1790971665.836796:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745220736:12345-192.168.203.43@tcp:400: Request processed in 42us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971665.836803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00080000:3.0:1790971665.836826:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790971665.836832:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971665.837615:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1790971665.837626:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745220992:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1790971665.837869:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2355:x1877969745220992:12345-192.168.203.43@tcp:400: Request processed in 245us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971665.837877:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00080000:3.0:1790971665.840542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971665.854546:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220480 00000100:00100000:0.0:1790971665.854568:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220480 00000100:00100000:0.0:1790971665.858129:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745220608 00000100:00100000:0.0:1790971665.858152:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745220608 00000100:00100000:0.0:1790971665.858240:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:0.0:1790971665.858251:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5596:x1877969745220480:12345-192.168.203.43@tcp:101: 00010000:00010000:0.0:1790971665.858275:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971665.858299:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbd600/0xbd3388eaa6f495ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a23f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971665.858337:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbd600/0xbd3388eaa6f495ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a23f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971665.858350:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbd600/0xbd3388eaa6f495ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a23f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971665.858361:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd600, rc 0) 00000100:00100000:0.0:1790971665.858445:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745220480:12345-192.168.203.43@tcp:101: Request processed in 195us (22450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971665.858453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:0.0:1790971665.858506:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:0.0:1790971665.858512:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:2355:x1877969745220608:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1790971665.858537:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:2355:x1877969745220608:12345-192.168.203.43@tcp:400: Request processed in 25us (22476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971665.862594:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:3.0:1790971665.882247:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971665.882401:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745221120 00000100:00100000:1.0:1790971665.882415:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745221120 00000100:00100000:1.0:1790971665.882541:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:1.0:1790971665.882554:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5596:x1877969745221120:12345-192.168.203.43@tcp:501: 00000100:00100000:1.0:1790971665.882967:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5596:x1877969745221120:12345-192.168.203.43@tcp:501: Request processed in 415us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971665.883437:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:3.0:1790971665.905427:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971665.925498:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745221248 00000100:00100000:2.0:1790971665.925519:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745221248 00000100:00100000:3.0:1790971665.928047:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:3.0:1790971665.928063:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5596:x1877969745221248:12345-192.168.203.43@tcp:503: 00000100:00100000:3.0:1790971665.928633:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5596:x1877969745221248:12345-192.168.203.43@tcp:503: Request processed in 572us (23217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971665.928642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:2.0:1790971665.944010:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971665.950530:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745221376 00000100:00100000:0.0:1790971665.950554:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745221376 00000100:00100000:0.0:1790971665.950648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:0.0:1790971665.950661:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:6094:x1877969745221376:12345-192.168.203.43@tcp:502: 00000100:00100000:0.0:1790971665.955391:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:6094:x1877969745221376:12345-192.168.203.43@tcp:502: Request processed in 4717us (11391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971665.955428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:0.0:1790971665.969980:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971665.970137:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745221504 00000100:00100000:1.0:1790971665.970150:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745221504 00000100:00100000:1.0:1790971665.970219:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:1.0:1790971665.970229:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+9:6094:x1877969745221504:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971665.970640:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+9:6094:x1877969745221504:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 411us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971665.970660:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:1.0:1790971665.978519:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971665.980530:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745221632 00000100:00100000:3.0:1790971665.980550:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745221632 00000100:00100000:3.0:1790971665.980656:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:3.0:1790971665.980667:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5596:x1877969745221632:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971665.980691:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971665.980715:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f495b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a246 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971665.980765:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f495b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a246 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971665.980789:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f495b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a246 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971665.980800:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002de00, rc 0) 00000100:00100000:3.0:1790971665.980884:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745221632:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 219us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971665.980893:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:2.0:1790971665.991547:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971665.991760:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745221760 00000100:00100000:0.0:1790971665.991772:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745221760 00000100:00100000:0.0:1790971665.991839:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:0.0:1790971665.991850:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745221760:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971665.992518:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745221760:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 667us (981us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790971665.992528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 172 00010000:00010000:0.0:1790971666.532757:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971667.556746:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790971667.832389:0:8510:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccfa68f70 20000000:00000080:2.0:1790971667.832411:0:8510:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cd3859e9000 uarg=0000000000000000 20000000:01000000:2.0:1790971667.832456:0:8510:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790971667.832463:0:8510:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790971667.832519:0:8510:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790971667.835722:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1790971667.835860:0:8510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1790971667.850768:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1790971667.850838:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1790971667.850910:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1790971667.850942:0:8510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790971667.850967:0:8510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.850991:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbda00/0xbd3388eaa6f49330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.850999:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.851006:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.851028:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.851037:0:8510:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.851091:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.851110:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 9 pid: 5831 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971667.851129:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220416:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971667.851272:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.851282:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 18 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971667.851294:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220544:0@lo:104: 00000100:00100000:2.0:1790971667.851352:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971667.851453:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766220544 00000100:00100000:1.0:1790971667.851464:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766220544 00000100:00100000:1.0:1790971667.851557:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790971667.851570:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:8510:x1877969766220544:12345-0@lo:104: 00010000:00010000:1.0:1790971667.851588:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.852701:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.852719:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 18 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971667.852746:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220672:0@lo:104: 00010000:00010000:1.0:1790971667.856806:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790971667.856829:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:8510:x1877969766220544:12345-0@lo:104: Request processed in 5255us (5471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971667.856845:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790971667.857028:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790971667.857144:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbda00/0xbd3388eaa6f49330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.857162:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbda00/0xbd3388eaa6f49330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 18 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971667.857177:0:5823:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790971667.857182:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220800:0@lo:104: 00000100:00100000:1.0:1790971667.857199:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766220672 00000100:00100000:1.0:1790971667.857210:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766220672 00000100:00100000:2.0:1790971667.857242:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790971667.857298:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971667.857311:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.857322:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934600 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971667.857327:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.857339:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971667.857347:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971667.857354:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790971667.857394:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.857423:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790971667.857440:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766220800 00000100:00100000:1.0:1790971667.857446:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766220800 00000100:00100000:2.0:1790971667.857448:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6780 going to sleep for 11 seconds 00010000:00010000:0.0:1790971667.857450:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.857460:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494934600/0xbd3388eaa6f49456 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4945d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971667.857496:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1790971667.857502:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971667.857506:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971667.857511:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:8510:x1877969766220672:12345-0@lo:104: 00010000:00010000:0.0:1790971667.857511:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971667.857526:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.857539:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766220928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971667.857597:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790971667.857606:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:8510:x1877969766220672:12345-0@lo:104: Request processed in 99us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971667.857608:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971667.857618:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790971667.857656:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220544:0@lo:104: 00000100:00100000:2.0:1790971667.857673:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220672:0@lo:104: 00000100:00100000:0.0:1790971667.857677:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766220928 00000100:00100000:0.0:1790971667.857683:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766220928 00000100:00100000:1.0:1790971667.857685:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790971667.857695:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:8510:x1877969766220800:12345-0@lo:104: 00010000:00010000:1.0:1790971667.857705:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.857711:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.857751:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790971667.857756:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790971667.857763:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766220928:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971667.857770:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:8510:x1877969766220800:12345-0@lo:104: Request processed in 73us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971667.857779:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1790971667.857781:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971667.857790:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.857801:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790971667.857803:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.857810:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.857820:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934a00 already unused, calling callback (ffffffffc1c89c20) 00010000:00010000:0.0:1790971667.857824:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4945d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49456 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971667.857825:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.857842:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971667.857851:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220800:0@lo:104: 10000000:00010000:1.0:1790971667.857864:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971667.857872:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790971667.857874:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971667.857902:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.857911:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3304:x1877969766220928:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (305us total) trans 0 rc 0/0 00010000:00010000:1.0:1790971667.857912:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790971667.857923:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790971667.857947:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.857967:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4938b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49392 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.857967:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766220928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790971667.857992:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1790971667.857995:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971667.857999:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.858001:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766221056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971667.858013:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002cc00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:1.0:1790971667.858017:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.858026:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.858034:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1790971667.858040:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971667.858046:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790971667.858066:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.858069:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221056 00000100:00100000:0.0:1790971667.858075:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221056 00010000:00010000:1.0:1790971667.858076:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971667.858094:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 18 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.858101:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.858110:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f49329 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49330 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971667.858121:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1790971667.858127:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971667.858128:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766221184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790971667.858131:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3304:x1877969766221056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971667.858136:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971667.858141:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971667.858144:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971667.858150:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971667.858150:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 18 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971667.858169:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971667.858215:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221184 00000100:00100000:2.0:1790971667.858220:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221184 00010000:00010000:2.0:1790971667.858238:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbda00/0xbd3388eaa6f49330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971667.858497:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790971667.858507:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766221184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790971667.858516:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971667.858521:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbda00/0xbd3388eaa6f49330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.858531:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbda00/0xbd3388eaa6f49330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.858556:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbda00/0xbd3388eaa6f49330 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49329 expref: 19 pid: 5834 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.858569:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971667.858602:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3302:x1877969766221184:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971667.858609:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790971667.858639:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766221184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971667.862920:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971667.863008:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745221888 00000100:00100000:1.0:1790971667.863020:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745221888 00010000:00010000:1.0:1790971667.863078:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 10 pid: 5831 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971667.863136:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1790971667.863148:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2357:x1877969745221888:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971667.863168:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971667.863174:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 10 pid: 5831 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.863191:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 10 pid: 5831 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.863215:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971667.863300:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2357:x1877969745221888:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 153us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971667.863309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00010000:00010000:0.0:1790971667.864093:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 17 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.864113:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbd400/0xbd3388eaa6f49392 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4938b expref: 17 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.864132:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971667.864166:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864235:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864246:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864265:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864274:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864293:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d58a00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971667.864299:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864310:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864321:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971667.864335:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971667.864412:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3304:x1877969766221056:12345-0@lo:103:ldlm_bl.0 Request processed in 6282us (6379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971667.864421:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790971667.864661:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766221056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790971667.865224:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f4951a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a20e expref: 9 pid: 5831 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971667.865241:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1877969766220416:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971667.865274:0:8510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.865284:0:8510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.865290:0:8510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971667.865296:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971668.327572:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790971668.327604:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766221312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971668.327713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971668.328042:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221312 00000100:00100000:0.0:1790971668.328052:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221312 00000100:00100000:0.0:1790971668.328145:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790971668.328156:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766221312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971668.328206:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971668.328271:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766221312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971668.328278:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790971668.328324:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf11500 x1877969766221312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971668.328345:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766221312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971668.328493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790971668.592967:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971668.837253:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766221568:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.837352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971668.837425:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790971668.837432:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766221440:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.837464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971668.837512:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766221952:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.837541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971668.837572:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766221696:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.837617:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971668.837637:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971668.837642:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766221824:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.837664:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971668.837700:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221568 00000100:00100000:0.0:1790971668.837710:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221568 00000100:00100000:0.0:1790971668.837760:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221696 00000100:00100000:0.0:1790971668.837763:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221696 00000100:00100000:0.0:1790971668.837797:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221824 00000100:00100000:0.0:1790971668.837802:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221824 00000100:00100000:0.0:1790971668.837818:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790971668.837827:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766221568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.837895:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766221568:12345-0@lo:400:kworker.0 Request processed in 67us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971668.837904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790971668.837935:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790971668.837942:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.837975:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766221696:12345-0@lo:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971668.837982:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790971668.837993:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790971668.837998:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766221824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.838024:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766221824:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971668.838029:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790971668.838048:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221440 00000100:00100000:0.0:1790971668.838051:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221440 00000100:00100000:0.0:1790971668.838085:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1790971668.838091:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3305:x1877969766221440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.838121:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3305:x1877969766221440:12345-0@lo:400:kworker.0 Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971668.838128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1790971668.838159:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766221952 00000100:00100000:0.0:1790971668.838163:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766221952 00000100:00100000:0.0:1790971668.838193:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790971668.838199:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766221952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.838230:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766221952:12345-0@lo:400:kworker.0 Request processed in 31us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971668.838235:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790971668.838264:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971668.838269:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971668.838309:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766221824:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.838319:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766221696:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.838349:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766221440:0@lo:400:kworker.0 00010000:00080000:0.0:1790971668.838362:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf10700 x1877969766221952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971668.838373:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766221952:0@lo:400:kworker.0 00000100:00100000:0.0:1790971668.838382:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766221568:0@lo:400:kworker.0 00000100:00100000:1.0:1790971668.843800:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971668.843831:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766222080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971668.844152:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971668.844237:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222080 00000100:00100000:2.0:1790971668.844260:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222080 00000100:00100000:2.0:1790971668.844329:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790971668.844339:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766222080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971668.844388:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971668.844446:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766222080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971668.844455:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790971668.844592:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd488bc3800 x1877969766222080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971668.844614:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766222080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971669.036192:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971669.036334:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222016 00000100:00100000:1.0:1790971669.036348:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222016 00000100:00100000:1.0:1790971669.036421:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:1.0:1790971669.036432:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+9:5596:x1877969745222016:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971669.036456:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971669.036505:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a24d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971669.036563:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971669.036575:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971669.036585:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43600, rc 0) 00000100:00100000:1.0:1790971669.036655:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745222016:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 225us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971669.036664:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:1.0:1790971669.041087:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971669.041172:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222144 00000100:00100000:0.0:1790971669.041185:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222144 00000100:00100000:0.0:1790971669.041273:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:0.0:1790971669.041283:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745222144:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.041675:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745222144:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 390us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971669.041685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:3.0:1790971669.045075:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971669.045521:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222272 00000100:00100000:0.0:1790971669.045534:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222272 00000100:00100000:0.0:1790971669.045603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 176 00000100:00100000:0.0:1790971669.045614:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745222272:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.045919:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:5596:x1877969745222272:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 304us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971669.046134:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 176 00000100:00100000:0.0:1790971669.055411:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971669.055856:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222400 00000100:00100000:1.0:1790971669.055872:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222400 00000100:00100000:1.0:1790971669.055957:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 177 00000100:00100000:1.0:1790971669.055969:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:6152:x1877969745222400:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971669.056300:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:6152:x1877969745222400:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 332us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971669.056309:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 177 00000100:00100000:1.0:1790971669.060192:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971669.061625:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222528 00000100:00100000:0.0:1790971669.061646:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222528 00000100:00100000:0.0:1790971669.061741:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 178 00000100:00100000:0.0:1790971669.061753:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:6152:x1877969745222528:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790971669.062123:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:6152:x1877969745222528:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 371us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971669.062132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 178 10000000:01000000:0.0:1790971669.351798:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790971669.351809:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4bfbb1000 from 4 10000000:01000000:0.0:1790971669.351816:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790971669.351895:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.351908:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.351952:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971669.351985:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.352083:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971669.352150:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971669.352207:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222208 00000100:00100000:3.0:1790971669.352218:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222208 00000100:00100000:3.0:1790971669.352293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790971669.352303:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766222208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971669.352321:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971669.352339:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f495c9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.352382:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.352393:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.352403:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d400, rc 0) 00000100:00100000:3.0:1790971669.352459:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766222208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971669.352491:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790971669.352839:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971669.352856:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.352866:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971669.352955:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.352988:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971669.353017:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971669.353064:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222336 00000100:00100000:2.0:1790971669.353069:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222336 00000100:00100000:2.0:1790971669.353101:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790971669.353110:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766222336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971669.353448:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766222336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971669.353456:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790971669.354090:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.354141:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.354201:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971669.354237:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971669.354333:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222464 00000100:00100000:2.0:1790971669.354340:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222464 00000100:00100000:2.0:1790971669.354382:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790971669.354391:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766222464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971669.354622:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766222464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971669.354630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790971669.354740:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971669.355513:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8560:1877969766222592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971669.355575:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971669.355603:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1790971669.355664:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222592 00000100:00100000:0.0:1790971669.355671:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222592 00000100:00100000:0.0:1790971669.355726:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790971669.355735:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8560:x1877969766222592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971669.355951:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8560:x1877969766222592:12345-0@lo:502:llog_process_th.0 Request processed in 215us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971669.355965:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790971669.356238:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8560:1877969766222592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971669.356271:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971669.356284:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971669.356287:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790971669.356296:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4bfbb1000 00000020:00000080:3.0:1790971669.356299:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790971669.356399:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8560:1877969766222720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971669.356442:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971669.356459:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1790971669.356603:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222720 00000100:00100000:2.0:1790971669.356610:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222720 00000100:00100000:2.0:1790971669.356651:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790971669.356659:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8560:x1877969766222720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971669.356851:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:8560:x1877969766222720:12345-0@lo:502:llog_process_th.0 Request processed in 193us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971669.356865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790971669.359916:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8560:1877969766222720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971669.359987:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971669.360008:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971669.360011:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790971669.360017:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790971669.364782:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790971669.364831:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971669.364846:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.364862:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971669.364874:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790971669.364877:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4be529000 from 4 10000000:01000000:0.0:1790971669.364880:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790971669.364939:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.364949:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.364962:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971669.364995:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.365088:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971669.365150:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b251b840 going to sleep for 11 seconds 00000100:00100000:3.0:1790971669.368601:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222848 00000100:00100000:3.0:1790971669.368625:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222848 00000100:00100000:3.0:1790971669.368704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790971669.368727:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766222848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971669.368752:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971669.368775:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f495d7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.368811:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.368824:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.368834:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c800, rc 0) 00000100:00100000:3.0:1790971669.368959:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766222848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (3871us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971669.368967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790971669.369041:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971669.369064:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.369075:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971669.369166:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971669.369217:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971669.369265:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971669.369282:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766222976 00000100:00100000:3.0:1790971669.369285:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766222976 00000100:00100000:3.0:1790971669.369310:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790971669.369317:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766222976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971669.369638:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766222976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971669.369645:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790971669.369677:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766222976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971669.369707:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971669.369747:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971669.369759:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971669.369769:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766223104 00000100:00100000:3.0:1790971669.369773:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766223104 00000100:00100000:3.0:1790971669.369793:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790971669.369799:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766223104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971669.369979:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766223104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971669.369986:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790971669.370022:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.374759:0:8562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8562:1877969766223232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971669.374888:0:8562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971669.374936:0:8562:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b251b840 going to sleep for 11 seconds 00000100:00100000:3.0:1790971669.374945:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766223232 00000100:00100000:3.0:1790971669.374955:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766223232 00000100:00100000:3.0:1790971669.375006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790971669.375016:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8562:x1877969766223232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971669.377714:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8562:x1877969766223232:12345-0@lo:502:llog_process_th.0 Request processed in 2688us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971669.377730:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790971669.379554:0:8562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8562:1877969766223232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790971669.379613:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971669.379627:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971669.379630:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790971669.379638:0:8562:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4be529000 00000020:00000080:1.0:1790971669.379641:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790971669.379776:0:8562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8562:1877969766223360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971669.379867:0:8562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971669.379911:0:8562:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383300 going to sleep for 11 seconds 00000100:00100000:2.0:1790971669.381348:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766223360 00000100:00100000:2.0:1790971669.381363:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766223360 00000100:00100000:2.0:1790971669.381437:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790971669.381447:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8562:x1877969766223360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971669.381768:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:8562:x1877969766223360:12345-0@lo:502:llog_process_th.0 Request processed in 322us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971669.381777:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790971669.382966:0:8562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8562:1877969766223360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790971669.383032:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971669.383042:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971669.383045:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790971669.383051:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790971669.383338:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790971669.383365:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790971669.383379:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.383394:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971669.383406:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790971669.383409:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4b52bc800 from 4 10000000:01000000:3.0:1790971669.383412:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790971669.383556:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.383566:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971669.383577:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971669.383607:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790971669.383683:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971669.384772:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971669.397741:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766223488 00000100:00100000:0.0:1790971669.397765:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766223488 00000100:00100000:0.0:1790971669.397852:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790971669.397868:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766223488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971669.397891:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971669.397917:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f495e5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.397965:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.397977:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.397988:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc400, rc 0) 00000100:00100000:0.0:1790971669.398100:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766223488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (14417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971669.398107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790971669.398188:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971669.398211:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.398222:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971669.400875:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.400989:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971669.401039:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957abcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971669.401146:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766223616 00000100:00100000:2.0:1790971669.401157:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766223616 00000100:00100000:2.0:1790971669.401218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790971669.401236:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766223616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971669.401793:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766223616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 563us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971669.401803:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790971669.402365:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.402428:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.403402:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971669.403453:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971669.403497:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766223744 00000100:00100000:0.0:1790971669.403505:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766223744 00000100:00100000:0.0:1790971669.403562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790971669.403572:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766223744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971669.403933:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766223744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 361us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971669.403943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790971669.404008:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766223744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971669.406189:0:8564:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8564:1877969766223872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971669.406804:0:8564:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971669.412158:0:8564:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971669.419831:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766223872 00000100:00100000:0.0:1790971669.419850:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766223872 00000100:00100000:0.0:1790971669.419934:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1790971669.419946:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:8564:x1877969766223872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971669.420265:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:8564:x1877969766223872:12345-0@lo:502:llog_process_th.0 Request processed in 319us (13461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971669.420274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790971669.420444:0:8564:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8564:1877969766223872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790971669.420515:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971669.420527:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971669.420530:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790971669.420539:0:8564:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4b52bc800 00000020:00000080:2.0:1790971669.420542:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790971669.420647:0:8564:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8564:1877969766224000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971669.420718:0:8564:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971669.420748:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224000 00000100:00100000:2.0:1790971669.420752:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224000 00000100:00100000:2.0:1790971669.420781:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790971669.420788:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:8564:x1877969766224000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971669.420911:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:8564:x1877969766224000:12345-0@lo:502:llog_process_th.0 Request processed in 122us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971669.420930:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790971669.420975:0:8564:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971669.420987:0:8564:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:8564:1877969766224000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790971669.421005:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971669.421010:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971669.421011:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790971669.421015:0:8564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790971669.423161:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790971669.423211:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971669.423239:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.423255:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971669.605659:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971670.645156:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971670.971781:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971670.971846:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971670.971874:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971670.971954:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971670.971993:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222784 00000100:00100000:3.0:1790971670.972005:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222784 00000100:00100000:3.0:1790971670.972089:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:3.0:1790971670.972100:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745222784:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971670.972198:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745222784:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971670.972206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00080000:3.0:1790971670.972238:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971670.973432:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222656 00000100:00100000:1.0:1790971670.973447:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222656 00000100:00100000:1.0:1790971670.973550:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1790971670.973560:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745222656:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971670.973645:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745222656:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 86us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971670.973653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1790971670.973701:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745222912 00000100:00100000:1.0:1790971670.973706:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745222912 00000100:00100000:1.0:1790971670.973747:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223040 00000100:00100000:1.0:1790971670.973751:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223040 00000100:00100000:1.0:1790971670.973775:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1790971670.973782:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745222912:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971670.973812:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745222912:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971670.973819:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1790971670.973831:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1790971670.973838:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745223040:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971670.973863:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745223040:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971670.973869:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00080000:0.0:1790971670.975556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971670.975569:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790971671.652896:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971672.678393:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971673.453045:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766224128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971673.453146:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971673.453246:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224128 00000100:00100000:1.0:1790971673.453256:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224128 00000100:00100000:1.0:1790971673.453325:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790971673.453336:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766224128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790971673.453384:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971673.453439:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766224128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971673.453447:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790971673.453507:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790971673.453545:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd488bc3800 x1877969766224128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971673.453566:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766224128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790971673.705105:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971673.957829:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766224256:0@lo:400:kworker.0 00000100:00100000:0.0:1790971673.958000:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971673.958058:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766224768:0@lo:400:kworker.0 00000100:00100000:0.0:1790971673.958090:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971673.958124:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790971673.958129:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766224640:0@lo:400:kworker.0 00000100:00100000:0.0:1790971673.958161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971673.958196:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766224384:0@lo:400:kworker.0 00000100:00100000:0.0:1790971673.958222:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971673.958242:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971673.958247:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766224512:0@lo:400:kworker.0 00000100:00100000:0.0:1790971673.958271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971673.958305:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224256 00000100:00100000:0.0:1790971673.958314:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224256 00000100:00100000:0.0:1790971673.959759:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790971673.959774:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766224256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971673.959882:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766224256:12345-0@lo:400:kworker.0 Request processed in 111us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971673.959912:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790971673.959996:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766224896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971673.960041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971673.960087:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224896 00000100:00100000:3.0:1790971673.960096:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224896 00000100:00100000:3.0:1790971673.960141:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790971673.960148:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766224896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971673.960185:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971673.960224:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766224896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971673.960230:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1790971673.960257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790971673.960291:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0fd880 x1877969766224896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971673.960311:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766224896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971673.972534:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224640 00000100:00100000:3.0:1790971673.972555:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224640 00000100:00100000:3.0:1790971673.972635:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224384 00000100:00100000:3.0:1790971673.972650:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224384 00000100:00100000:3.0:1790971673.972671:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224512 00000100:00100000:3.0:1790971673.972673:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224512 00000100:00100000:3.0:1790971673.972698:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790971673.972708:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766224640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971673.972839:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766224640:12345-0@lo:400:kworker.0 Request processed in 131us (14676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971673.972859:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790971673.972899:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790971673.972905:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766224384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971673.972944:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766224384:12345-0@lo:400:kworker.0 Request processed in 39us (14720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971673.972950:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790971673.972963:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790971673.972970:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766224512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971673.973000:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766224512:12345-0@lo:400:kworker.0 Request processed in 30us (14727us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971673.973006:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790971673.973035:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766224768 00000100:00100000:3.0:1790971673.973039:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766224768 00000100:00100000:3.0:1790971673.973070:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790971673.973077:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766224768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971673.973111:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766224768:12345-0@lo:400:kworker.0 Request processed in 35us (15021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971673.973117:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790971673.973143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971673.973917:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766224512:0@lo:400:kworker.0 00000100:00100000:3.0:1790971673.973952:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766224384:0@lo:400:kworker.0 00000100:00100000:2.0:1790971673.976875:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766224640:0@lo:400:kworker.0 00000100:00100000:2.0:1790971673.976907:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766224256:0@lo:400:kworker.0 00010000:00080000:2.0:1790971673.976928:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf10700 x1877969766224768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971673.976940:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766224768:0@lo:400:kworker.0 00010000:00010000:0.0:1790971674.734396:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971675.756930:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971676.084292:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971676.084340:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971676.084371:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971676.084395:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971676.084430:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223296 00000100:00100000:1.0:1790971676.084444:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223296 00000100:00100000:1.0:1790971676.084551:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1790971676.084563:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745223296:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971676.084673:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745223296:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 112us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971676.084682:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1790971676.084750:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223424 00000100:00100000:1.0:1790971676.084753:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223424 00000100:00100000:1.0:1790971676.084778:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223552 00000100:00100000:1.0:1790971676.084780:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223552 00000100:00100000:1.0:1790971676.084799:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971676.084806:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2353:x1877969745223424:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:1.0:1790971676.085114:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49528 00000100:00080000:1.0:1790971676.085128:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cd4be196000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790971676.085176:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790971676.086010:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+2:2353:x1877969745223424:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 1022us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971676.086022:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971676.086124:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1790971676.086137:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2353:x1877969745223552:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:1.0:1790971676.086164:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f4952f 00000100:00080000:1.0:1790971676.086173:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cd4883eb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790971676.086203:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790971676.086417:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+2:2353:x1877969745223552:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 284us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971676.086425:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00080000:1.0:1790971676.086459:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790971676.086464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790971676.086468:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971676.086679:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223168 00000100:00100000:0.0:1790971676.086689:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223168 00000100:00100000:0.0:1790971676.086750:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:0.0:1790971676.086758:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745223168:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971676.086791:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745223168:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 35us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971676.086798:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 196 00010000:00010000:0.0:1790971676.087252:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971676.087309:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790971676.640887:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1790971676.776310:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971677.799807:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971678.564794:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766225024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971678.564880:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971678.564980:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225024 00000100:00100000:3.0:1790971678.564989:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225024 00000100:00100000:3.0:1790971678.565042:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790971678.565053:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766225024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971678.565092:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971678.565140:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766225024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971678.565148:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1790971678.565195:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd488bc0e00 x1877969766225024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971678.565213:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766225024:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790971678.565281:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790971678.827616:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971679.076877:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790971679.076902:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766225152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971679.076978:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971679.077047:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225152 00000100:00100000:1.0:1790971679.077057:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225152 00000100:00100000:1.0:1790971679.077128:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790971679.077147:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766225152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971679.077183:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971679.077235:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766225152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971679.077254:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1790971679.077310:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0ff480 x1877969766225152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971679.077329:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766225152:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790971679.077394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971679.077825:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971679.077838:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766225280:0@lo:400:kworker.0 00000100:00100000:2.0:1790971679.077880:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766225408:0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.077898:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971679.077921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971679.077934:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766225664:0@lo:400:kworker.0 00000100:00100000:2.0:1790971679.077959:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971679.077967:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766225536:0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.077973:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971679.077995:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971679.078003:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766225792:0@lo:400:kworker.0 00000100:00100000:2.0:1790971679.078017:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971679.078037:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971679.078055:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225408 00000100:00100000:2.0:1790971679.078061:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225408 00000100:00100000:2.0:1790971679.078094:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225536 00000100:00100000:2.0:1790971679.078098:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225536 00000100:00100000:0.0:1790971679.078099:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225280 00000100:00100000:0.0:1790971679.078105:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225280 00000100:00100000:2.0:1790971679.078122:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225792 00000100:00100000:2.0:1790971679.078126:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225792 00000100:00100000:0.0:1790971679.078140:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790971679.078150:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790971679.078153:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766225280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971679.078161:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766225408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.078201:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766225280:12345-0@lo:400:kworker.0 Request processed in 51us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971679.078215:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766225408:12345-0@lo:400:kworker.0 Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971679.078219:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790971679.078228:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790971679.078257:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225664 00000100:00100000:2.0:1790971679.078261:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790971679.078263:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225664 00000100:00100000:2.0:1790971679.078271:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766225536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.078295:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790971679.078303:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766225664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.078335:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766225664:12345-0@lo:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971679.078342:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790971679.078360:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790971679.078366:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766225792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.078396:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766225792:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971679.078401:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790971679.078618:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766225536:12345-0@lo:400:kworker.0 Request processed in 348us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971679.078626:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1790971679.078647:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971679.079068:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766225536:0@lo:400:kworker.0 00000100:00100000:2.0:1790971679.079080:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766225408:0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.079278:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766225792:0@lo:400:kworker.0 00010000:00080000:0.0:1790971679.079291:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0ff100 x1877969766225664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971679.079301:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766225664:0@lo:400:kworker.0 00000100:00100000:0.0:1790971679.079308:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766225280:0@lo:400:kworker.0 00000001:00100000:3.0:1790971679.141383:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:3.0:1790971679.141392:0:6714:0:(genops.c:885:class_export_put()) final put ffff8cd4be197000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000100:00100000:3.0:1790971679.147839:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971679.147894:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971679.147928:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223680 00000100:00100000:3.0:1790971679.147938:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223680 00000020:00000080:2.0:1790971679.148288:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be197000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 for lustre-OST0000 00000020:00000080:2.0:1790971679.148339:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4be196000 for lustre-OST0000 00000100:00100000:3.0:1790971679.148864:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:3.0:1790971679.148876:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745223680:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971679.149631:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223808 00000100:00100000:0.0:1790971679.149642:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223808 00000100:00100000:0.0:1790971679.149709:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1790971679.149719:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745223808:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971679.149732:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745223680:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 856us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971679.149751:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:0.0:1790971679.149770:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745223808:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 51us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971679.149790:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000001:00100000:3.0:1790971679.149802:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:3.0:1790971679.149807:0:7646:0:(genops.c:885:class_export_put()) final put ffff8cd4883ec000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000100:00080000:2.0:1790971679.149837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1790971679.149839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4883ec000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 for lustre-OST0001 00000020:00000080:3.0:1790971679.149896:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4883eb000 for lustre-OST0001 00010000:00010000:3.0:1790971679.847023:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971680.870175:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971681.200970:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971681.204167:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971681.208182:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224064 00000100:00100000:2.0:1790971681.208198:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224064 00000100:00100000:2.0:1790971681.208286:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:2.0:1790971681.208297:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745224064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971681.208371:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745224064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 76us (7409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971681.208378:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00080000:3.0:1790971681.208440:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971681.208865:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745223936 00000100:00100000:1.0:1790971681.208871:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745223936 00000100:00100000:1.0:1790971681.208970:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 199 00000100:00100000:1.0:1790971681.208978:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2357:x1877969745223936:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971681.209021:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2357:x1877969745223936:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 44us (4863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971681.209028:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 199 00000001:02000400:1.0:1790971681.404024:0:9054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing yml_node 00010000:00010000:0.0:1790971681.901011:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971682.916638:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971683.686260:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766225920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971683.686358:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971683.686692:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766225920 00000100:00100000:1.0:1790971683.686701:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766225920 00000100:00100000:1.0:1790971683.686790:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790971683.686799:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766225920:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971683.686850:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790971683.686863:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971683.686921:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766225920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971683.686929:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1790971683.687108:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd488bc1c00 x1877969766225920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971683.687128:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766225920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790971683.942913:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971684.196725:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766226176:0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.196752:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766226432:0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.196859:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971684.196922:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790971684.196929:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766226048:0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.196963:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971684.196989:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766226560:0@lo:400:kworker.0 00000100:00100000:0.0:1790971684.197065:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971684.197074:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226048 00000100:00100000:2.0:1790971684.197083:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226048 00000100:00100000:2.0:1790971684.197139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790971684.197149:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766226048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971684.197174:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766226688:0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.197221:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766226048:12345-0@lo:400:kworker.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971684.197229:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971684.197234:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790971684.197269:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971684.197550:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971684.197557:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766226304:0@lo:400:kworker.0 00000100:00100000:1.0:1790971684.197713:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766226816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971684.197879:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226432 00000100:00100000:3.0:1790971684.197885:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226432 00000100:00100000:3.0:1790971684.197917:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226688 00000100:00100000:3.0:1790971684.197920:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226688 00000100:00100000:3.0:1790971684.197950:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790971684.197958:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766226432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.201769:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766226048:0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.201925:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226176 00000100:00100000:2.0:1790971684.201933:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226176 00000100:00100000:2.0:1790971684.201982:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226560 00000100:00100000:2.0:1790971684.201997:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226560 00000100:00100000:2.0:1790971684.202041:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790971684.202049:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971684.202054:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766226176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.202112:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766226176:12345-0@lo:400:kworker.0 Request processed in 63us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971684.202119:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790971684.202293:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766226432:12345-0@lo:400:kworker.0 Request processed in 4335us (5434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971684.202301:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790971684.202326:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790971684.202334:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766226688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971684.202367:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766226688:12345-0@lo:400:kworker.0 Request processed in 35us (5142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971684.202373:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790971684.202988:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790971684.202997:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766226560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.203038:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766226560:12345-0@lo:400:kworker.0 Request processed in 42us (5769us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971684.203045:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790971684.203089:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766226560:0@lo:400:kworker.0 00010000:00080000:2.0:1790971684.203104:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0fc700 x1877969766226432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971684.203114:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766226432:0@lo:400:kworker.0 00000100:00100000:1.0:1790971684.203215:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226816 00000100:00100000:1.0:1790971684.203222:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226816 00000100:00080000:3.0:1790971684.203255:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790971684.203263:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971684.203436:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790971684.203446:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766226816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971684.203489:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971684.203536:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766226816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971684.203543:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790971684.203702:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790971684.203736:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd488bc0000 x1877969766226816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971684.203738:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226304 00000100:00100000:0.0:1790971684.203743:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226304 00000100:00100000:2.0:1790971684.203761:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766226816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971684.203799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790971684.203806:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766226304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971684.205381:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766226304:12345-0@lo:400:kworker.0 Request processed in 1568us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971684.205393:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1790971684.205943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790971684.205968:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0fe680 x1877969766226688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971684.205986:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766226688:0@lo:400:kworker.0 00000100:00100000:0.0:1790971684.206002:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766226176:0@lo:400:kworker.0 00000100:00100000:0.0:1790971684.206027:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766226304:0@lo:400:kworker.0 00010000:00010000:0.0:1790971684.968877:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971685.988832:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971686.318853:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971686.319107:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971686.322848:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224192 00000100:00100000:1.0:1790971686.322868:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224192 00000100:00100000:1.0:1790971686.322965:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:1.0:1790971686.323058:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745224192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971686.323171:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745224192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 194us (4332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971686.323180:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:3.0:1790971686.323789:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224320 00000100:00100000:3.0:1790971686.323808:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224320 00000100:00100000:3.0:1790971686.323875:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1790971686.323885:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745224320:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971686.323956:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745224320:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (4849us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971686.323963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00080000:2.0:1790971686.324660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790971686.508429:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.2 00010000:00010000:0.0:1790971687.016947:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971688.040672:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971688.805965:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971688.806223:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766226944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971688.806296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971688.806900:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766226944 00000100:00100000:0.0:1790971688.806909:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766226944 00000100:00100000:0.0:1790971688.807009:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790971688.807107:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766226944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971688.807147:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971688.807208:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766226944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971688.807216:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1790971688.807285:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f361f80 x1877969766226944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971688.807303:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766226944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790971688.807450:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1790971689.051821:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.2 00010000:00010000:3.0:1790971689.062895:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971689.318348:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766227456:0@lo:400:kworker.0 00000100:00100000:2.0:1790971689.318416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971689.318464:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790971689.318502:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766227072:0@lo:400:kworker.0 00000100:00100000:2.0:1790971689.318532:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971689.318552:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766227584:0@lo:400:kworker.0 00000100:00100000:3.0:1790971689.318816:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227456 00000100:00100000:3.0:1790971689.318824:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227456 00000100:00100000:3.0:1790971689.318866:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790971689.318874:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766227456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971689.318924:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766227456:12345-0@lo:400:kworker.0 Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971689.318931:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790971689.319354:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227072 00000100:00100000:1.0:1790971689.319360:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227072 00000100:00100000:1.0:1790971689.319386:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790971689.319393:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766227072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971689.319428:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766227072:12345-0@lo:400:kworker.0 Request processed in 37us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971689.319435:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1790971689.319542:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790971689.319726:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0fdc00 x1877969766227456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971689.319741:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766227456:0@lo:400:kworker.0 00000100:00100000:2.0:1790971689.319764:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766227072:0@lo:400:kworker.0 00000100:00100000:2.0:1790971689.319798:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766227200:0@lo:400:kworker.0 00000100:00100000:2.0:1790971689.319823:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971689.319841:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766227712:0@lo:400:kworker.0 00000100:00100000:2.0:1790971689.319859:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971689.319873:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790971689.319878:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766227328:0@lo:400:kworker.0 00000100:00100000:2.0:1790971689.319895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971689.319909:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766227840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971689.319928:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971689.319951:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227584 00000100:00100000:2.0:1790971689.319955:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227584 00000100:00100000:2.0:1790971689.319983:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227200 00000100:00100000:2.0:1790971689.319991:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227200 00000100:00100000:1.0:1790971689.320084:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227328 00000100:00100000:1.0:1790971689.320089:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227328 00000100:00100000:1.0:1790971689.320107:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790971689.320119:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766227584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971689.320157:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766227584:12345-0@lo:400:kworker.0 Request processed in 38us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971689.320163:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790971689.320175:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790971689.320181:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766227200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971689.320209:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766227200:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971689.320215:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790971689.320225:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790971689.320231:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766227328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971689.320256:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766227328:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971689.320263:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790971689.320293:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766227584:0@lo:400:kworker.0 00000100:00100000:1.0:1790971689.320315:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766227328:0@lo:400:kworker.0 00000100:00100000:1.0:1790971689.320323:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766227200:0@lo:400:kworker.0 00000100:00100000:3.0:1790971689.320457:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227712 00000100:00100000:3.0:1790971689.320462:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227712 00000100:00100000:3.0:1790971689.320506:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790971689.320518:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766227712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971689.320557:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766227712:12345-0@lo:400:kworker.0 Request processed in 40us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971689.320563:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790971689.320760:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227840 00000100:00100000:3.0:1790971689.320765:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227840 00000100:00100000:3.0:1790971689.320799:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790971689.320807:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766227840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971689.320833:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971689.320866:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766227840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971689.320872:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790971689.321191:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790971689.321196:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790971689.322491:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bd8a2d80 x1877969766227840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971689.322513:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766227840:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1790971689.322526:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be0fe680 x1877969766227712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971689.322534:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766227712:0@lo:400:kworker.0 00010000:00010000:0.0:1790971690.084917:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971691.111880:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971691.436582:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971691.436617:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971691.436649:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224448 00000100:00100000:0.0:1790971691.436658:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224448 00000100:00100000:0.0:1790971691.436709:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:0.0:1790971691.436719:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745224448:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971691.436798:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2356:x1877969745224448:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971691.436806:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:0.0:1790971691.436837:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224576 00000100:00100000:0.0:1790971691.436841:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224576 00000100:00100000:0.0:1790971691.436881:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:0.0:1790971691.436888:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745224576:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971691.436917:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745224576:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971691.436924:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00080000:3.0:1790971691.438992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1790971691.460254:0:9441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.2 00010000:00010000:3.0:1790971692.133647:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971693.156639:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790971693.368576:0:9490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Oct 2 16:08:11 EDT 2026 00000100:00100000:3.0:1790971693.926336:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971693.926359:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766227968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971693.926428:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971693.926556:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766227968 00000100:00100000:0.0:1790971693.926564:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766227968 00000100:00100000:0.0:1790971693.926632:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790971693.926642:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766227968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971693.926675:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971693.926718:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766227968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971693.926726:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1790971693.926802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790971693.926843:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f361880 x1877969766227968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971693.926875:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766227968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790971694.180689:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971694.437105:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971694.437129:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766228096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971694.437186:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766228224:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.437204:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971694.437274:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766228480:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.437305:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971694.437325:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971694.437345:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766228608:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.437372:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971694.437421:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228096 00000100:00100000:1.0:1790971694.437505:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228096 00000100:00100000:1.0:1790971694.437572:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971694.437581:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766228096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971694.437612:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971694.437655:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766228096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971694.437662:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971694.437687:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228480 00000100:00100000:1.0:1790971694.437691:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228480 00000100:00100000:1.0:1790971694.437717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790971694.437724:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766228480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.437768:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766228480:12345-0@lo:400:kworker.0 Request processed in 45us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971694.437775:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790971694.437792:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228608 00000100:00100000:1.0:1790971694.437795:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228608 00000100:00100000:1.0:1790971694.437837:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790971694.437838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971694.437850:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766228608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971694.437876:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766228736:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.437889:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766228608:12345-0@lo:400:kworker.0 Request processed in 42us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971694.437897:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790971694.437907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971694.437925:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228736 00000100:00100000:1.0:1790971694.437930:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228736 00000100:00100000:3.0:1790971694.437934:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790971694.437943:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766228352:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.437962:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790971694.437970:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766228736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971694.437983:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971694.438001:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766228864:0@lo:400:kworker.0 00000100:00100000:3.0:1790971694.438032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971694.438040:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766228736:12345-0@lo:400:kworker.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971694.438048:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790971694.438062:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228352 00000100:00100000:1.0:1790971694.438066:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228352 00000100:00100000:3.0:1790971694.438069:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766228736:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.438086:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790971694.438095:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766228352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971694.438114:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228864 00000100:00100000:3.0:1790971694.438119:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228864 00000100:00100000:1.0:1790971694.438137:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766228352:12345-0@lo:400:kworker.0 Request processed in 42us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971694.438145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790971694.438151:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790971694.438159:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766228864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.438174:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228224 00000100:00100000:1.0:1790971694.438180:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228224 00000100:00100000:3.0:1790971694.438197:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766228864:12345-0@lo:400:kworker.0 Request processed in 37us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971694.438205:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790971694.438211:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790971694.438222:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766228224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.438261:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766228224:12345-0@lo:400:kworker.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971694.438267:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1790971694.438671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790971694.438677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790971694.438762:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf11c00 x1877969766228608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971694.438775:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766228608:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.438788:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766228480:0@lo:400:kworker.0 00010000:00080000:1.0:1790971694.438798:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bd8a0000 x1877969766228096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971694.438814:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766228096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971694.438865:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766228352:0@lo:400:kworker.0 00010000:00080000:1.0:1790971694.438876:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bdf10e00 x1877969766228864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971694.438884:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766228864:0@lo:400:kworker.0 00000100:00100000:1.0:1790971694.438892:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766228224:0@lo:400:kworker.0 00010000:00010000:1.0:1790971695.205283:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971696.228599:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971696.551632:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971696.551679:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971696.551866:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224704 00000100:00100000:0.0:1790971696.551880:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224704 00000100:00100000:0.0:1790971696.551955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:0.0:1790971696.551966:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745224704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971696.552139:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745224704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 173us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971696.552149:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:1.0:1790971696.553956:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224832 00000100:00100000:1.0:1790971696.553976:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224832 00000100:00080000:3.0:1790971696.554063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971696.554082:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:1.0:1790971696.554095:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745224832:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971696.554201:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745224832:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 108us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971696.554209:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00010000:00010000:0.0:1790971697.252761:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971698.277168:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971699.047399:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971699.047423:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766228992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971699.047521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971699.047593:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766228992 00000100:00100000:3.0:1790971699.047601:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766228992 00000100:00100000:3.0:1790971699.047656:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790971699.047666:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766228992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971699.047712:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971699.047759:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766228992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971699.047767:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790971699.047794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790971699.047824:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4bd8a1180 x1877969766228992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971699.047843:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766228992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790971699.301487:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971699.558837:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766229504:0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.558908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971699.558965:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790971699.558973:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766229120:0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.559002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971699.559023:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766229632:0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.559044:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971699.559068:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766229248:0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.559087:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971699.559117:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766229760:0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.559139:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971699.559157:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790971699.559162:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766229376:0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.559183:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971699.559211:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766229504 00000100:00100000:1.0:1790971699.559218:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766229504 00000100:00100000:1.0:1790971699.559256:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766229760 00000100:00100000:1.0:1790971699.559259:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766229760 00000100:00100000:1.0:1790971699.559282:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790971699.559289:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766229504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.559335:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766229504:12345-0@lo:400:kworker.0 Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971699.559341:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790971699.559359:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971699.559364:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766229760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.559392:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766229760:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971699.559397:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971699.559413:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766229120 00000100:00100000:1.0:1790971699.559415:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766229120 00000100:00100000:1.0:1790971699.559440:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1790971699.559446:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766229120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971699.560090:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766229632 00000100:00100000:0.0:1790971699.560097:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766229632 00000100:00100000:0.0:1790971699.560135:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766229248 00000100:00100000:0.0:1790971699.560138:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766229248 00000100:00100000:0.0:1790971699.560149:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766229376 00000100:00100000:0.0:1790971699.560152:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766229376 00000100:00100000:0.0:1790971699.560166:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790971699.560173:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766229632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971699.560257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790971699.560265:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766229248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971699.563009:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766229888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971699.564176:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766229632:12345-0@lo:400:kworker.0 Request processed in 3997us (5124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971699.564190:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790971699.564246:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790971699.564259:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766229376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971699.564309:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766229376:12345-0@lo:400:kworker.0 Request processed in 56us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971699.564315:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790971699.564378:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766229632:0@lo:400:kworker.0 00010000:00080000:0.0:1790971699.564393:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be2efb80 x1877969766229504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971699.564404:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766229504:0@lo:400:kworker.0 00000100:00100000:0.0:1790971699.564460:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766229376:0@lo:400:kworker.0 00010000:00080000:0.0:1790971699.564488:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be2ec700 x1877969766229760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971699.564498:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766229760:0@lo:400:kworker.0 00000100:00080000:0.0:1790971699.565856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971699.565865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971699.565991:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766229120:12345-0@lo:400:kworker.0 Request processed in 6539us (6982us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971699.566003:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790971699.566056:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766229120:0@lo:400:kworker.0 00000100:00100000:3.0:1790971699.566593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971699.566606:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766229248:12345-0@lo:400:kworker.0 Request processed in 6341us (7516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971699.566615:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790971699.566679:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766229888 00000100:00100000:1.0:1790971699.566705:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766229888 00000100:00100000:1.0:1790971699.566751:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790971699.566757:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766229888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971699.566787:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971699.566853:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766229888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971699.566855:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766229248:0@lo:400:kworker.0 00000100:00100000:1.0:1790971699.566859:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790971699.566989:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495773b80 x1877969766229888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971699.567006:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766229888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790971700.324935:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971701.356741:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971701.670048:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971701.670123:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971701.670166:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745224960 00000100:00100000:3.0:1790971701.670179:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745224960 00000100:00100000:3.0:1790971701.670248:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:3.0:1790971701.670257:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2354:x1877969745224960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971701.670343:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2354:x1877969745224960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971701.670351:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:1.0:1790971701.671314:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225088 00000100:00100000:1.0:1790971701.671324:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225088 00000100:00100000:1.0:1790971701.671409:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1790971701.671420:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2354:x1877969745225088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971701.671531:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2354:x1877969745225088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 111us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971701.671543:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00080000:3.0:1790971701.674195:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790971702.373463:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971703.398242:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971704.175491:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790971704.175521:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766230016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971704.175630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971704.175722:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230016 00000100:00100000:2.0:1790971704.175732:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230016 00000100:00100000:2.0:1790971704.175802:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790971704.175812:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766230016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971704.175857:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971704.175908:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766230016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971704.175916:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790971704.175977:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be2eca80 x1877969766230016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971704.175994:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766230016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971704.176201:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790971704.420819:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971704.678406:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766230400:0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.678564:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971704.678639:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790971704.678646:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766230272:0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.678683:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971704.678722:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230400 00000100:00100000:2.0:1790971704.678732:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230400 00000100:00100000:0.0:1790971704.678747:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766230144:0@lo:400:kworker.0 00000100:00100000:0.0:1790971704.678791:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971704.678797:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230272 00000100:00100000:2.0:1790971704.678800:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230272 00000100:00100000:0.0:1790971704.678816:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766230656:0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.678823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790971704.678832:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766230400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971704.678854:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971704.678873:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790971704.678878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766230528:0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.678890:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766230400:12345-0@lo:400:kworker.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971704.678898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790971704.678899:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971704.678915:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230528 00000100:00100000:2.0:1790971704.678918:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230528 00000100:00100000:0.0:1790971704.678925:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790971704.679012:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1790971704.679152:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971704.682557:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766230272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971704.682780:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766230272:12345-0@lo:400:kworker.0 Request processed in 3845us (4094us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971704.682794:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790971704.682929:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230144 00000100:00100000:0.0:1790971704.682940:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230144 00000100:00100000:0.0:1790971704.683268:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790971704.683279:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766230144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971704.683334:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766230144:12345-0@lo:400:kworker.0 Request processed in 57us (4541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971704.683340:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790971704.683379:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230656 00000100:00100000:0.0:1790971704.683384:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230656 00000100:00100000:0.0:1790971704.683427:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790971704.683433:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766230656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971704.683491:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766230656:12345-0@lo:400:kworker.0 Request processed in 37us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971704.683498:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790971704.685395:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766230144:0@lo:400:kworker.0 00010000:00080000:0.0:1790971704.685420:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be2ef100 x1877969766230656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971704.685453:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766230656:0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.685586:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766230528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.685707:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766230528:12345-0@lo:400:kworker.0 Request processed in 6688us (6805us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971704.685718:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790971704.685788:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766230272:0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.685818:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766230400:0@lo:400:kworker.0 00000100:00100000:2.0:1790971704.685837:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790971704.685850:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766230784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971704.685896:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971704.686081:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766230528:0@lo:400:kworker.0 00000100:00100000:0.0:1790971704.686085:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230784 00000100:00100000:0.0:1790971704.686092:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230784 00000100:00100000:0.0:1790971704.686279:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790971704.686288:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766230784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790971704.686325:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971704.686364:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766230784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971704.686369:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790971704.686648:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495771180 x1877969766230784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971704.686674:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766230784:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790971704.687062:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790971705.449992:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971706.473080:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971706.790589:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971706.790652:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971706.790735:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225344 00000100:00100000:1.0:1790971706.790745:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225344 00000100:00100000:0.0:1790971706.790817:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225216 00000100:00100000:0.0:1790971706.790822:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225216 00000100:00100000:1.0:1790971706.790835:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1790971706.790846:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745225344:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971706.790860:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:0.0:1790971706.790869:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745225216:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971706.791031:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745225344:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 186us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971706.791040:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00080000:3.0:1790971706.791388:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971706.796386:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745225216:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 5496us (5782us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971706.796401:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 209 00010000:00010000:2.0:1790971707.492923:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971708.527174:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971709.289037:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be18aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766230912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971709.289137:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971709.289231:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766230912 00000100:00100000:2.0:1790971709.289242:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766230912 00000100:00100000:2.0:1790971709.289311:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790971709.289321:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766230912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971709.289368:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971709.289421:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766230912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.289429:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1790971709.289454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790971709.289510:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be18aa00 x1877969766230912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971709.289532:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be18aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766230912:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1790971709.354112:0:10120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:08:27 (1790971707) === 00010000:00010000:1.0:1790971709.544849:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971709.798941:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766231040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971709.799034:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971709.799135:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231040 00000100:00100000:3.0:1790971709.799144:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231040 00000100:00100000:3.0:1790971709.799210:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790971709.799221:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766231040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971709.799270:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971709.799321:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766231040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971709.799328:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1790971709.799359:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790971709.799393:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495772a00 x1877969766231040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971709.799414:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766231040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971709.800603:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766231296:0@lo:400:kworker.0 00000100:00100000:1.0:1790971709.800689:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766231552:0@lo:400:kworker.0 00000100:00100000:2.0:1790971709.800690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971709.800885:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766231168:0@lo:400:kworker.0 00000100:00100000:0.0:1790971709.803937:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766231424:0@lo:400:kworker.0 00000100:00100000:1.0:1790971709.803966:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231296 00000100:00100000:1.0:1790971709.803979:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231296 00000100:00100000:1.0:1790971709.804157:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790971709.804168:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766231296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971709.804879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971709.809199:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231168 00000100:00100000:3.0:1790971709.809219:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231168 00000100:00100000:3.0:1790971709.809301:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790971709.809312:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766231168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971709.809462:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971709.809900:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971709.809943:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231424 00000100:00100000:0.0:1790971709.809948:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231424 00000100:00100000:0.0:1790971709.809987:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231552 00000100:00100000:0.0:1790971709.809990:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231552 00000100:00100000:0.0:1790971709.810006:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790971709.810013:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766231424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971709.810112:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766231424:12345-0@lo:400:kworker.0 Request processed in 53us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.810137:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766231296:12345-0@lo:400:kworker.0 Request processed in 5967us (9442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971709.810145:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790971709.810151:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790971709.810182:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790971709.810193:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766231552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971709.810250:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766231552:12345-0@lo:400:kworker.0 Request processed in 60us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.810258:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790971709.810265:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766231168:12345-0@lo:400:kworker.0 Request processed in 952us (5385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971709.810307:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766231552:0@lo:400:kworker.0 00000100:00100000:1.0:1790971709.810310:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766231424:0@lo:400:kworker.0 00000100:00100000:0.0:1790971709.810377:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766231296:0@lo:400:kworker.0 00000100:00100000:3.0:1790971709.810396:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1790971709.810408:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971709.810429:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766231168:0@lo:400:kworker.0 00000100:00100000:2.0:1790971709.810691:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971709.810851:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225472 00000100:00100000:1.0:1790971709.810857:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225472 00000100:00100000:1.0:1790971709.810896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:1.0:1790971709.810905:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+10:8138:x1877969745225472:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790971709.810919:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971709.811066:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42000/0xbd3388eaa6f495f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a254 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971709.811102:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42000/0xbd3388eaa6f495f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a254 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971709.811116:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd42000/0xbd3388eaa6f495f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a254 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971709.811135:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42000, rc 0) 00000100:00100000:1.0:1790971709.811221:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8138:x1877969745225472:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 317us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.811230:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:0.0:1790971709.814965:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971709.815084:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225600 00000100:00100000:2.0:1790971709.815097:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225600 00000100:00100000:2.0:1790971709.815210:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:2.0:1790971709.815224:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8138:x1877969745225600:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790971709.815928:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8138:x1877969745225600:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 704us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.815937:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:2.0:1790971709.825034:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971709.825168:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225728 00000100:00100000:1.0:1790971709.825183:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225728 00000100:00100000:1.0:1790971709.825251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:1.0:1790971709.825263:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8138:x1877969745225728:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790971709.825645:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8138:x1877969745225728:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 383us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.825653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:0.0:1790971709.836440:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971709.836525:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225856 00000100:00100000:2.0:1790971709.836538:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225856 00000100:00100000:2.0:1790971709.836608:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:2.0:1790971709.836619:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8142:x1877969745225856:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790971709.837184:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8142:x1877969745225856:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 563us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.837195:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:3.0:1790971709.873061:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971709.873159:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745225984 00000100:00100000:1.0:1790971709.873172:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745225984 00000100:00100000:1.0:1790971709.873237:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:1.0:1790971709.873247:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8142:x1877969745225984:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971709.873675:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8142:x1877969745225984:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 428us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.873685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:3.0:1790971709.880564:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971709.880838:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745226112 00000100:00100000:2.0:1790971709.880851:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745226112 00000100:00100000:2.0:1790971709.880917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:2.0:1790971709.880927:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+11:8138:x1877969745226112:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790971709.880949:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971709.880974:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a27e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971709.881011:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a27e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971709.881046:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a27e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971709.881057:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58a00, rc 0) 00000100:00100000:2.0:1790971709.881127:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+12:8138:x1877969745226112:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 200us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.881135:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:3.0:1790971709.884717:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971709.885956:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745226240 00000100:00100000:0.0:1790971709.885973:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745226240 00000100:00100000:0.0:1790971709.886050:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:0.0:1790971709.886060:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:8138:x1877969745226240:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790971709.886092:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790971709.886123:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790971709.886127:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790971709.886131:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790971709.886133:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1790971709.895051:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:8138:x1877969745226240:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 8975us (10332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971709.895070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:3.0:1790971709.897398:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971709.898083:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745226368 00000100:00100000:1.0:1790971709.898097:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745226368 00000100:00100000:1.0:1790971709.898168:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:1.0:1790971709.898179:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:8138:x1877969745226368:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790971709.898201:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971709.898224:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a285 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971709.898277:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971709.898289:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971709.898299:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43e00, rc 0) 00000100:00100000:1.0:1790971709.898379:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8138:x1877969745226368:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 202us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.898388:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:1.0:1790971709.900335:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971709.900437:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745226496 00000100:00100000:0.0:1790971709.900550:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745226496 00000100:00100000:0.0:1790971709.900599:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:0.0:1790971709.900608:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8138:x1877969745226496:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790971709.901124:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8138:x1877969745226496:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 515us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971709.901144:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:3.0:1790971709.902633:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971709.902788:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745226624 00000100:00100000:2.0:1790971709.902799:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745226624 00000100:00100000:2.0:1790971709.902853:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:2.0:1790971709.902862:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8138:x1877969745226624:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790971709.903122:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8138:x1877969745226624:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 260us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.903131:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:3.0:1790971709.905517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971709.906083:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745226752 00000100:00100000:1.0:1790971709.906097:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745226752 00000100:00100000:1.0:1790971709.906167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 221 00000100:00100000:1.0:1790971709.906178:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8146:x1877969745226752:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971709.906578:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8146:x1877969745226752:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 399us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.906588:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 221 00000100:00100000:1.0:1790971709.910916:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971709.911051:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745226880 00000100:00100000:0.0:1790971709.911064:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745226880 00000100:00100000:0.0:1790971709.911136:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:0.0:1790971709.911148:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8146:x1877969745226880:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790971709.911805:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:8146:x1877969745226880:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 656us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971709.911817:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:3.0:1790971709.929745:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971709.929791:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971709.929999:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227008 00000100:00100000:1.0:1790971709.930013:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227008 00000100:00100000:1.0:1790971709.930067:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227392 00000100:00100000:1.0:1790971709.930070:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227392 00000100:00100000:1.0:1790971709.930127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:1.0:1790971709.930137:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745227392:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971709.930223:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745227392:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.930246:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:1.0:1790971709.930272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971709.930276:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1877969745227008:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790971709.930302:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from be25fcca-2306-4aa1-b74f-3903af7f4a28@192.168.203.43@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:1.0:1790971709.930340:0:5839:0:(genops.c:1384:class_connect()) connect: client be25fcca-2306-4aa1-b74f-3903af7f4a28, cookie 0xbd3388eaa6f49608 00000004:00100000:1.0:1790971709.930377:0:5839:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790971709.930743:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8cd4be098000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790971709.930781:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2353:x1877969745227008:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 503us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.930788:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00080000:3.0:1790971709.931273:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971709.934180:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971709.934301:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227264 00000100:00100000:1.0:1790971709.934314:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227264 00000100:00080000:3.0:1790971709.934520:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971709.934779:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1790971709.934791:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:8138:x1877969745227264:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790971709.934850:0:5839:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790971709.934999:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:8138:x1877969745227264:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 210us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971709.935008:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1790971709.936294:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971709.938139:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227136 00000100:00100000:2.0:1790971709.938156:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227136 00000100:00100000:2.0:1790971709.938233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1790971709.938241:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:0:x1877969745227136:12345-192.168.203.43@tcp:41:mount.lustre.0 00000100:00100000:3.0:1790971709.938256:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000004:00000024:2.0:1790971709.938286:0:5838:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790971709.938383:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:0:x1877969745227136:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 142us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.938392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1790971709.938411:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227520 00000100:00100000:2.0:1790971709.938415:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227520 00000100:00100000:2.0:1790971709.938461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1790971709.938516:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:8138:x1877969745227520:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790971709.938553:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:8138:x1877969745227520:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 39us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.938560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1790971709.940429:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971709.940466:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971709.940525:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227648 00000100:00100000:3.0:1790971709.940528:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971709.940536:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227648 00000100:00100000:0.0:1790971709.940583:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227776 00000100:00100000:0.0:1790971709.940587:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227776 00000100:00100000:0.0:1790971709.940607:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1790971709.940615:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1877969745227648:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790971709.940663:0:8047:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from be25fcca-2306-4aa1-b74f-3903af7f4a28@192.168.203.43@tcp t0 exp 0000000000000000 cur 288 last 0 00000100:00100000:3.0:1790971709.940667:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1790971709.940673:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877969745227776:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790971709.940688:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from be25fcca-2306-4aa1-b74f-3903af7f4a28@192.168.203.43@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1790971709.940704:0:8047:0:(genops.c:1384:class_connect()) connect: client be25fcca-2306-4aa1-b74f-3903af7f4a28, cookie 0xbd3388eaa6f4960f 00000020:00000080:3.0:1790971709.940708:0:6690:0:(genops.c:1384:class_connect()) connect: client be25fcca-2306-4aa1-b74f-3903af7f4a28, cookie 0xbd3388eaa6f49616 00002000:00100000:0.0:1790971709.940719:0:8047:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli be25fcca-2306-4aa1-b74f-3903af7f4a28/ffff8cd386fa8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790971709.940737:0:8047:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1790971709.940811:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli be25fcca-2306-4aa1-b74f-3903af7f4a28/ffff8cd487824800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790971709.940819:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790971709.941022:0:8047:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790971709.941059:0:8047:0:(import.c:65:import_set_state_nolock()) ffff8cd386fa8800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1790971709.941105:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790971709.941117:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cd487822000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790971709.941139:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2353:x1877969745227776:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 466us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971709.941139:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2353:x1877969745227648:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 523us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971709.941146:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1790971709.941160:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1790971709.941570:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745227904 00000100:00100000:2.0:1790971709.941578:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745227904 00000100:00100000:2.0:1790971709.941786:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1790971709.941799:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:8138:x1877969745227904:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790971709.941887:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790971709.942042:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:8138:x1877969745227904:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 247us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971709.942260:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00010000:00010000:2.0:1790971710.565072:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790971710.911392:0:5861:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be25fcca-2306-4aa1-b74f-3903af7f4a28 00010000:00010000:0.0:1790971711.588804:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971712.612683:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971713.637081:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971714.409259:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971714.409282:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766231680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971714.409348:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971714.409570:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231680 00000100:00100000:2.0:1790971714.409586:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231680 00000100:00100000:2.0:1790971714.409652:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790971714.409660:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766231680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971714.409692:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971714.409736:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766231680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971714.409743:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790971714.409788:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be188700 x1877969766231680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971714.409805:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766231680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790971714.410104:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790971714.661403:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971714.921411:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766231808:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.921506:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971714.921548:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766232320:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.921618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971714.921647:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790971714.921654:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766231936:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.921681:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971714.921711:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766232064:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.921747:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971714.921765:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971714.921771:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766232192:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.921805:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971714.921953:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231808 00000100:00100000:1.0:1790971714.921961:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231808 00000100:00100000:1.0:1790971714.922005:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790971714.922014:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766231808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922065:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766231808:12345-0@lo:400:kworker.0 Request processed in 52us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.922073:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790971714.922103:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232320 00000100:00100000:1.0:1790971714.922107:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232320 00000100:00100000:1.0:1790971714.922139:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790971714.922145:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766232320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922192:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766232320:12345-0@lo:400:kworker.0 Request processed in 46us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.922207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790971714.922226:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766231936 00000100:00100000:1.0:1790971714.922229:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766231936 00000100:00100000:1.0:1790971714.922253:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232064 00000100:00100000:1.0:1790971714.922256:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232064 00000100:00100000:1.0:1790971714.922268:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232192 00000100:00100000:1.0:1790971714.922271:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232192 00000100:00100000:1.0:1790971714.922282:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790971714.922287:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766231936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922319:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766231936:12345-0@lo:400:kworker.0 Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.922324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790971714.922336:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790971714.922341:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766232064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922371:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766232064:12345-0@lo:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.922377:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790971714.922389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790971714.922394:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766232192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922418:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766232192:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.922424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1790971714.922445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790971714.922449:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971714.922496:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766232192:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922507:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766232064:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922540:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766231936:0@lo:400:kworker.0 00000100:00100000:1.0:1790971714.922548:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766231808:0@lo:400:kworker.0 00010000:00080000:1.0:1790971714.922560:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8dc00 x1877969766232320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971714.922571:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766232320:0@lo:400:kworker.0 00000100:00100000:3.0:1790971714.928693:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971714.928717:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766232448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971714.928798:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971714.929130:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232448 00000100:00100000:3.0:1790971714.929138:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232448 00000100:00100000:3.0:1790971714.929181:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790971714.929189:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766232448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971714.929224:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971714.929285:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766232448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971714.929292:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1790971714.929465:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f363800 x1877969766232448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971714.929506:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766232448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971714.990057:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971714.990094:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971714.990123:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971714.990142:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971714.990226:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971714.990330:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228032 00000100:00100000:1.0:1790971714.990340:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228032 00000100:00100000:1.0:1790971714.990385:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:1.0:1790971714.990395:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745228032:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971714.990460:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745228032:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 67us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.990467:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:1.0:1790971714.990520:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228544 00000100:00100000:1.0:1790971714.990524:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228544 00000100:00100000:1.0:1790971714.990553:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228416 00000100:00100000:0.0:1790971714.990861:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228288 00000100:00100000:0.0:1790971714.990866:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228288 00000100:00100000:0.0:1790971714.990895:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228160 00000100:00100000:0.0:1790971714.990898:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228160 00000100:00100000:0.0:1790971714.990919:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:0.0:1790971714.990927:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745228288:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971714.990964:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745228288:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971714.990971:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:0.0:1790971714.990984:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1790971714.990990:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745228160:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971714.991028:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745228160:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 38us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971714.991034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:1.0:1790971714.991098:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228416 00000100:00100000:1.0:1790971714.991125:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1790971714.991132:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2356:x1877969745228544:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971714.991159:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2356:x1877969745228544:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.991248:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1790971714.991525:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:1.0:1790971714.991534:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2356:x1877969745228416:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971714.991576:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2356:x1877969745228416:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971714.991582:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00080000:1.0:1790971714.992775:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790971714.992781:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790971714.992784:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1790971714.999741:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be25fcca-2306-4aa1-b74f-3903af7f4a28 00000001:00100000:3.0:1790971715.020718:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be25fcca-2306-4aa1-b74f-3903af7f4a28 00010000:00010000:1.0:1790971715.684721:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790971715.700067:0:10318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1790971716.711699:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971717.743432:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971718.757794:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971719.526969:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790971719.527007:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766232576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971719.527099:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971719.527327:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232576 00000100:00100000:0.0:1790971719.527337:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232576 00000100:00100000:0.0:1790971719.527419:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790971719.527440:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766232576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971719.527522:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971719.527586:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766232576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971719.527594:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1790971719.529093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790971719.529150:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f363100 x1877969766232576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971719.529176:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766232576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790971719.781650:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971720.037030:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766232832:0@lo:400:kworker.0 00000100:00100000:0.0:1790971720.037128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971720.037207:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971720.037231:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766232960:0@lo:400:kworker.0 00000100:00100000:0.0:1790971720.037259:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971720.037301:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232832 00000100:00100000:0.0:1790971720.037313:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232832 00000100:00100000:0.0:1790971720.037365:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232960 00000100:00100000:0.0:1790971720.037368:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232960 00000100:00100000:0.0:1790971720.037402:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790971720.037412:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766232832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971720.037535:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766232832:12345-0@lo:400:kworker.0 Request processed in 123us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971720.037544:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790971720.037573:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790971720.037579:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766232960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971720.037608:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766232960:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971720.037613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1790971720.037630:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971720.037982:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766232960:0@lo:400:kworker.0 00000100:00100000:0.0:1790971720.037996:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766232832:0@lo:400:kworker.0 00000100:00100000:3.0:1790971720.038236:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766233088:0@lo:400:kworker.0 00000100:00100000:3.0:1790971720.038281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971720.038312:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790971720.038319:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766232704:0@lo:400:kworker.0 00000100:00100000:3.0:1790971720.038348:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971720.038369:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766233216:0@lo:400:kworker.0 00000100:00100000:3.0:1790971720.038396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971720.038617:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790971720.038627:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766233344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971720.039332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971720.039630:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233088 00000100:00100000:0.0:1790971720.039640:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233088 00000100:00100000:0.0:1790971720.039767:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790971720.039867:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233344 00000100:00100000:2.0:1790971720.039872:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233344 00000100:00100000:2.0:1790971720.039908:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790971720.039915:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766233344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971720.039962:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971720.040034:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766233344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971720.040042:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790971720.040173:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766233088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790971720.040279:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971720.040284:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790971720.040570:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f362a00 x1877969766233344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971720.040592:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766233344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971720.040844:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233216 00000100:00100000:3.0:1790971720.040851:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233216 00000100:00100000:3.0:1790971720.040889:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790971720.040897:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766233216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971720.040961:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766233216:12345-0@lo:400:kworker.0 Request processed in 64us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971720.040968:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790971720.040999:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766232704 00000100:00100000:3.0:1790971720.041003:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766232704 00000100:00100000:3.0:1790971720.041029:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790971720.041036:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766232704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971720.041070:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766232704:12345-0@lo:400:kworker.0 Request processed in 35us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971720.041076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790971720.041131:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766232704:0@lo:400:kworker.0 00010000:00080000:3.0:1790971720.041144:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f363100 x1877969766233216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971720.041152:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766233216:0@lo:400:kworker.0 00000100:00100000:0.0:1790971720.052065:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766233088:12345-0@lo:400:kworker.0 Request processed in 12275us (13769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971720.052083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790971720.052986:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766233088:0@lo:400:kworker.0 00000100:00100000:3.0:1790971720.110222:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971720.110273:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971720.110319:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971720.110350:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971720.110381:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228928 00000100:00100000:0.0:1790971720.110394:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228928 00000100:00100000:3.0:1790971720.110402:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971720.110425:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228800 00000100:00100000:3.0:1790971720.110429:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228800 00000100:00100000:2.0:1790971720.110562:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229184 00000100:00100000:2.0:1790971720.110567:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229184 00000100:00100000:2.0:1790971720.110601:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229056 00000100:00100000:2.0:1790971720.110604:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229056 00000100:00100000:2.0:1790971720.110630:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1790971720.110639:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229184:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971720.110738:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229184:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 99us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971720.110759:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1790971720.110787:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1790971720.110794:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229056:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971720.110822:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229056:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971720.110828:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1790971720.111411:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:3.0:1790971720.111427:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745228800:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971720.111515:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745228800:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 93us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971720.113738:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745228672 00000100:00100000:1.0:1790971720.113758:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745228672 00000100:00100000:1.0:1790971720.113837:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:1.0:1790971720.113848:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2355:x1877969745228672:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971720.113947:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2355:x1877969745228672:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 99us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971720.113955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00080000:1.0:1790971720.114082:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790971720.114090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790971720.114093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971720.114870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1790971720.114893:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745228928:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971720.114976:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745228928:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 94us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971720.114984:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:3.0:1790971720.117124:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00010000:00010000:3.0:1790971720.804588:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971721.828773:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971722.852767:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971723.876635:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971724.650290:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971724.650311:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766233472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971724.650379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971724.660716:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233472 00000100:00100000:2.0:1790971724.660731:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233472 00000100:00100000:2.0:1790971724.660813:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790971724.660823:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766233472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971724.660862:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790971724.660866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971724.660946:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766233472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (10566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971724.660954:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1790971724.661076:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f361880 x1877969766233472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971724.661097:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766233472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790971724.900676:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971725.157578:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766233600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971725.157648:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971725.157727:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233600 00000100:00100000:3.0:1790971725.157734:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233600 00000100:00100000:3.0:1790971725.157786:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790971725.157796:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766233600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971725.157832:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971725.157883:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766233600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971725.157891:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1790971725.157921:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790971725.157952:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd487d84a80 x1877969766233600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971725.157970:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766233600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971725.158742:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766233728:0@lo:400:kworker.0 00000100:00100000:3.0:1790971725.158788:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971725.158851:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233728 00000100:00100000:3.0:1790971725.158856:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233728 00000100:00100000:3.0:1790971725.158891:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790971725.158900:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766233728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971725.158950:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766233728:12345-0@lo:400:kworker.0 Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971725.158957:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790971725.159122:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766233728:0@lo:400:kworker.0 00000100:00100000:3.0:1790971725.163719:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766233856:0@lo:400:kworker.0 00000100:00100000:0.0:1790971725.163743:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766234240:0@lo:400:kworker.0 00000100:00100000:2.0:1790971725.163823:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766233984:0@lo:400:kworker.0 00000100:00100000:0.0:1790971725.164288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971725.164399:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790971725.164504:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766234112:0@lo:400:kworker.0 00000100:00100000:0.0:1790971725.164618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971725.164653:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766234240 00000100:00100000:0.0:1790971725.164667:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766234240 00000100:00100000:0.0:1790971725.164723:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790971725.164733:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766234240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971725.164785:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766234240:12345-0@lo:400:kworker.0 Request processed in 54us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971725.164793:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790971725.164816:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766234112 00000100:00100000:0.0:1790971725.164820:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766234112 00000100:00100000:0.0:1790971725.164843:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790971725.164849:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766234112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971725.164880:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766234112:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971725.164886:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1790971725.164908:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790971725.164945:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f363100 x1877969766234112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971725.164959:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766234112:0@lo:400:kworker.0 00000100:00100000:0.0:1790971725.164970:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766234240:0@lo:400:kworker.0 00000100:00100000:3.0:1790971725.168148:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971725.168378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971725.168482:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233856 00000100:00100000:3.0:1790971725.168491:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233856 00000100:00100000:3.0:1790971725.168545:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766233984 00000100:00100000:3.0:1790971725.168549:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766233984 00000100:00100000:3.0:1790971725.168571:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790971725.168579:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766233856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971725.168640:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766233856:12345-0@lo:400:kworker.0 Request processed in 62us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971725.168647:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790971725.168668:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790971725.168675:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766233984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971725.168708:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766233984:12345-0@lo:400:kworker.0 Request processed in 34us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971725.168715:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790971725.168751:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766233984:0@lo:400:kworker.0 00000100:00100000:3.0:1790971725.168778:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766233856:0@lo:400:kworker.0 00000100:00080000:0.0:1790971725.168925:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971725.222214:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971725.222255:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971725.222297:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971725.222320:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971725.222452:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229696 00000100:00100000:1.0:1790971725.222461:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229696 00000100:00100000:1.0:1790971725.222565:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1790971725.222575:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229696:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971725.222654:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229696:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 80us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971725.222662:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00080000:1.0:1790971725.222683:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971725.222968:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971725.222995:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229312 00000100:00100000:2.0:1790971725.223000:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229312 00000100:00100000:2.0:1790971725.223038:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:2.0:1790971725.223053:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2355:x1877969745229312:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971725.223086:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2355:x1877969745229312:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 34us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971725.223091:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:0.0:1790971725.223771:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229824 00000100:00100000:0.0:1790971725.223778:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229824 00000100:00100000:0.0:1790971725.223830:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:0.0:1790971725.223839:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229824:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971725.223857:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229440 00000100:00100000:3.0:1790971725.223869:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229440 00000100:00100000:0.0:1790971725.223884:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229824:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 46us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971725.223892:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:3.0:1790971725.223919:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229568 00000100:00100000:3.0:1790971725.223923:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229568 00000100:00100000:3.0:1790971725.223948:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:3.0:1790971725.223955:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745229440:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971725.223990:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745229440:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971725.223997:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:3.0:1790971725.224018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:3.0:1790971725.224025:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229568:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:2.0:1790971725.224107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790971725.224111:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971725.224186:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745229568:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 161us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971725.224192:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00010000:00010000:3.0:1790971725.929645:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971726.948632:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971727.972646:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971728.996620:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971729.764921:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790971729.764951:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766234368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971729.765047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971729.765759:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766234368 00000100:00100000:0.0:1790971729.765770:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766234368 00000100:00100000:0.0:1790971729.765863:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790971729.765875:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766234368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971729.765926:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971729.765998:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766234368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971729.766006:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1790971729.766130:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790971729.766168:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be2edf80 x1877969766234368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971729.766191:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766234368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790971730.020631:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971730.276682:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766234624:0@lo:400:kworker.0 00000100:00100000:0.0:1790971730.276753:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971730.276795:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766235136:0@lo:400:kworker.0 00000100:00100000:0.0:1790971730.276816:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971730.276847:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971730.276852:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766234752:0@lo:400:kworker.0 00000100:00100000:0.0:1790971730.276884:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971730.276913:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235136 00000100:00100000:0.0:1790971730.276920:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235136 00000100:00100000:0.0:1790971730.276969:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790971730.276979:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766235136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971730.277032:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766235136:12345-0@lo:400:kworker.0 Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971730.277039:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1790971730.277058:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790971730.277085:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd49f360700 x1877969766235136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971730.277098:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766235136:0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277225:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766234880:0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277254:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971730.277276:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790971730.277281:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766234496:0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277303:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971730.277322:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766235008:0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277339:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971730.277360:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766234624 00000100:00100000:3.0:1790971730.277369:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766234624 00000100:00100000:3.0:1790971730.277392:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766234752 00000100:00100000:3.0:1790971730.277394:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766234752 00000100:00100000:3.0:1790971730.277408:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235008 00000100:00100000:3.0:1790971730.277410:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235008 00000100:00100000:3.0:1790971730.277421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790971730.277427:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766234624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277459:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766234624:12345-0@lo:400:kworker.0 Request processed in 32us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971730.277465:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790971730.277518:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790971730.277524:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766234752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277548:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766234752:12345-0@lo:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971730.277554:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790971730.277563:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790971730.277568:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766235008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277592:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766235008:12345-0@lo:400:kworker.0 Request processed in 24us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971730.277597:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790971730.277615:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766234496 00000100:00100000:3.0:1790971730.277618:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766234496 00000100:00100000:3.0:1790971730.277636:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790971730.277641:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766234496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.277664:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766234496:12345-0@lo:400:kworker.0 Request processed in 23us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971730.277670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790971730.277771:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766235264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971730.277794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971730.277822:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235264 00000100:00100000:3.0:1790971730.277826:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235264 00000100:00100000:3.0:1790971730.277848:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790971730.277854:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766235264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971730.277877:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971730.277906:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766235264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971730.277911:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1790971730.277928:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790971730.278204:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd487d84000 x1877969766235264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971730.278220:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766235264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971730.278244:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766234496:0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.278254:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766235008:0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.278389:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766234752:0@lo:400:kworker.0 00000100:00100000:3.0:1790971730.278399:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766234624:0@lo:400:kworker.0 00000100:00100000:0.0:1790971730.278978:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766234880 00000100:00100000:0.0:1790971730.278985:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766234880 00000100:00100000:0.0:1790971730.279024:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790971730.279032:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766234880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971730.279089:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766234880:12345-0@lo:400:kworker.0 Request processed in 59us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971730.279096:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1790971730.279125:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be2edf80 x1877969766234880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971730.279134:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766234880:0@lo:400:kworker.0 00000100:00100000:0.0:1790971730.361799:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971730.361841:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971730.361863:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971730.361879:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971730.361908:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971730.361932:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745229952 00000100:00100000:0.0:1790971730.361940:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745229952 00000100:00100000:0.0:1790971730.361992:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:0.0:1790971730.362001:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745229952:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971730.362060:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745229952:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 61us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971730.362068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:0.0:1790971730.362096:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230208 00000100:00100000:0.0:1790971730.362099:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230208 00000100:00100000:0.0:1790971730.362127:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230080 00000100:00100000:0.0:1790971730.362130:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230080 00000100:00100000:0.0:1790971730.362160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:0.0:1790971730.362166:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745230208:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971730.362195:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745230208:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971730.362202:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:0.0:1790971730.362214:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:0.0:1790971730.362220:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745230080:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971730.362242:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745230080:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971730.362249:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00080000:0.0:1790971730.362365:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971730.362385:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230336 00000100:00100000:0.0:1790971730.362388:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230336 00000100:00100000:0.0:1790971730.362415:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230464 00000100:00100000:0.0:1790971730.362418:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230464 00000100:00100000:0.0:1790971730.362438:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1790971730.362444:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2353:x1877969745230336:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:0.0:1790971730.362464:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f4960f 00000100:00080000:0.0:1790971730.362500:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cd386fa8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790971730.362540:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790971730.362835:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+2:2353:x1877969745230336:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 389us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971730.362842:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1790971730.362855:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1790971730.362861:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2353:x1877969745230464:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:0.0:1790971730.362882:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49616 00000100:00080000:0.0:1790971730.362887:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cd487822000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790971730.362907:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790971730.363091:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+2:2353:x1877969745230464:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 229us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971730.363097:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:0.0:1790971730.363116:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971730.363149:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790971730.363159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971730.363162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790971731.048819:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971732.068722:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971733.095466:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790971733.124837:0:11018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790971734.116588:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971734.893111:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766235392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971734.893215:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971734.897794:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235392 00000100:00100000:0.0:1790971734.897818:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235392 00000100:00100000:0.0:1790971734.897932:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790971734.897944:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766235392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971734.897999:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790971734.898614:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790971734.898773:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766235392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 829us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971734.898783:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790971734.900793:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be18a300 x1877969766235392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971734.900832:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766235392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790971735.141090:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971735.397233:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766235520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971735.397311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971735.397509:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235520 00000100:00100000:3.0:1790971735.397517:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235520 00000100:00100000:3.0:1790971735.397598:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790971735.397608:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766235520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971735.397661:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971735.397712:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766235520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971735.397720:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1790971735.397767:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd487d84000 x1877969766235520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971735.397784:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766235520:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790971735.400160:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971735.402323:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766235904:0@lo:400:kworker.0 00000100:00100000:1.0:1790971735.402404:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971735.402453:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790971735.402458:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766236032:0@lo:400:kworker.0 00000100:00100000:1.0:1790971735.402509:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971735.403211:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235904 00000100:00100000:0.0:1790971735.403220:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235904 00000100:00100000:0.0:1790971735.403282:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790971735.403290:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766235904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.403355:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766235904:12345-0@lo:400:kworker.0 Request processed in 65us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971735.403363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1790971735.403373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971735.403402:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766236032 00000100:00100000:0.0:1790971735.404263:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766236032 00000100:00100000:0.0:1790971735.404347:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790971735.404356:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4afc16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766236032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.404410:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4afc16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766236032:12345-0@lo:400:kworker.0 Request processed in 57us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971735.404416:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790971735.405087:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766235648:0@lo:400:kworker.0 00000100:00100000:3.0:1790971735.405132:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971735.405182:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766236160:0@lo:400:kworker.0 00000100:00100000:3.0:1790971735.405207:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971735.405232:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790971735.405238:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766235776:0@lo:400:kworker.0 00000100:00100000:3.0:1790971735.405257:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971735.405406:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235648 00000100:00100000:3.0:1790971735.405412:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235648 00000100:00100000:3.0:1790971735.405455:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790971735.405463:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766235648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971735.405525:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766235648:12345-0@lo:400:kworker.0 Request processed in 64us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971735.405533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790971735.405831:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766235648:0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.406232:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766236160 00000100:00100000:0.0:1790971735.406237:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766236160 00000100:00100000:0.0:1790971735.406328:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766235776 00000100:00100000:0.0:1790971735.406332:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766235776 00000100:00100000:0.0:1790971735.406355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790971735.406362:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766236160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.406420:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766236160:12345-0@lo:400:kworker.0 Request processed in 58us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971735.406427:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790971735.406458:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790971735.406464:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766235776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.406521:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766235776:12345-0@lo:400:kworker.0 Request processed in 56us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971735.406527:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1790971735.407311:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4b70c3b80 x1877969766236032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971735.407327:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766236032:0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.407341:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766235904:0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.407400:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766235776:0@lo:400:kworker.0 00000100:00100000:0.0:1790971735.408453:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766236160:0@lo:400:kworker.0 00000100:00080000:2.0:1790971735.408936:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1790971735.465122:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be25fcca-2306-4aa1-b74f-3903af7f4a28 00000020:00000080:1.0:1790971735.465132:0:6714:0:(genops.c:885:class_export_put()) final put ffff8cd386fa8000/be25fcca-2306-4aa1-b74f-3903af7f4a28 00000020:00000080:1.0:1790971735.465158:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd386fa8000/be25fcca-2306-4aa1-b74f-3903af7f4a28 for lustre-OST0000 00000020:00000080:1.0:1790971735.465209:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd386fa8800 for lustre-OST0000 00000100:00100000:3.0:1790971735.467365:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971735.467466:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230592 00000100:00100000:3.0:1790971735.467503:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230592 00000100:00100000:3.0:1790971735.467547:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:3.0:1790971735.467555:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745230592:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971735.467621:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745230592:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971735.467629:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 232 00000001:00100000:2.0:1790971735.471522:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be25fcca-2306-4aa1-b74f-3903af7f4a28 00000020:00000080:2.0:1790971735.471532:0:7646:0:(genops.c:885:class_export_put()) final put ffff8cd487824800/be25fcca-2306-4aa1-b74f-3903af7f4a28 00000020:00000080:0.0:1790971735.471583:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd487824800/be25fcca-2306-4aa1-b74f-3903af7f4a28 for lustre-OST0001 00000020:00000080:0.0:1790971735.471645:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd487822000 for lustre-OST0001 00000100:00100000:0.0:1790971735.473348:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971735.473538:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230720 00000100:00100000:2.0:1790971735.473548:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230720 00000100:00100000:2.0:1790971735.473620:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:2.0:1790971735.473629:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745230720:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971735.473695:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745230720:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 67us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971735.473703:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00080000:3.0:1790971735.473915:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971735.483282:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971735.483371:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230848 00000100:00100000:0.0:1790971735.483381:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230848 00000100:00080000:3.0:1790971735.483497:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971735.483497:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:0.0:1790971735.483508:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745230848:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971735.483585:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745230848:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971735.483593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00010000:00010000:1.0:1790971736.170034:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790971736.839836:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0d01c100 20000000:00000080:3.0:1790971736.839854:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cd4c024f800 uarg=0000000000000000 20000000:01000000:3.0:1790971736.839890:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790971736.839897:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790971736.839902:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790971736.840645:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790971736.840786:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790971736.850694:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790971736.850720:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850742:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850751:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850758:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850764:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850785:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850793:0:11168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850835:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.850850:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 12 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.850863:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236288:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971736.851656:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.851668:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 18 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.851680:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236416:0@lo:104: 00000100:00100000:3.0:1790971736.851724:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971736.851753:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.851760:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 18 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.851768:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236544:0@lo:104: 00000100:00100000:3.0:1790971736.851796:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971736.851814:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.851822:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 18 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.851830:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236672:0@lo:104: 00000100:00100000:3.0:1790971736.851849:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971736.851865:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.851874:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 12 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.851883:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236800:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971736.851911:0:11168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971736.851979:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766236416 00000100:00100000:1.0:1790971736.851987:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766236416 00000100:00100000:1.0:1790971736.852024:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766236544 00000100:00100000:1.0:1790971736.852028:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766236544 00000100:00100000:1.0:1790971736.852036:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766236672 00000100:00100000:1.0:1790971736.852039:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766236672 00000100:00100000:1.0:1790971736.852050:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790971736.852058:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+5:11168:x1877969766236416:12345-0@lo:104: 00010000:00010000:1.0:1790971736.852080:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852142:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790971736.852148:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+5:11168:x1877969766236416:12345-0@lo:104: Request processed in 91us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971736.852154:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790971736.852172:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790971736.852178:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+4:11168:x1877969766236544:12345-0@lo:104: 00010000:00010000:1.0:1790971736.852185:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852221:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790971736.852225:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+4:11168:x1877969766236544:12345-0@lo:104: Request processed in 49us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971736.852230:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790971736.852241:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790971736.852246:0:5822:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:11168:x1877969766236672:12345-0@lo:104: 00010000:00010000:1.0:1790971736.852254:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852290:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790971736.852295:0:5822:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+3:11168:x1877969766236672:12345-0@lo:104: Request processed in 50us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971736.852300:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790971736.852318:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790971736.852324:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852331:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002cc00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:1.0:1790971736.852336:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852344:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971736.852352:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971736.852357:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790971736.852398:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852405:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971736.852434:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852441:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f495e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852466:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790971736.852496:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852502:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbca00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:1.0:1790971736.852505:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852512:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971736.852518:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971736.852523:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790971736.852536:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852542:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971736.852558:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852564:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbca00/0xbd3388eaa6f495d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852571:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971736.852574:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852586:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd400 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:1.0:1790971736.852589:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852595:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971736.852600:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971736.852605:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790971736.852618:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852623:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971736.852629:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852635:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd400/0xbd3388eaa6f495c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f495d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852646:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971736.852648:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971736.852650:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971736.852656:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971736.852672:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766236928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971736.852702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971736.852727:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766237184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971736.852753:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971736.852768:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971736.852773:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766237056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971736.852791:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971736.852816:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766236928 00000100:00100000:1.0:1790971736.852820:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766236928 00010000:00010000:1.0:1790971736.852836:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 19 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971736.852854:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237184 00000100:00100000:1.0:1790971736.852857:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237184 00010000:00010000:1.0:1790971736.852867:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 20 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971736.852877:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237056 00000100:00100000:1.0:1790971736.852880:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237056 00010000:00010000:1.0:1790971736.852889:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 21 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971736.852900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790971736.852905:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b5253850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+21:3305:x1877969766236928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971736.852915:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971736.852919:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 21 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852926:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 21 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.852940:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971736.852966:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b5253850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+21:3305:x1877969766236928:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971736.852979:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790971736.853020:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790971736.853026:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+20:3303:x1877969766237184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971736.853033:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971736.853038:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 20 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.853046:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 20 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.853054:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971736.853080:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+20:3303:x1877969766237184:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971736.853085:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790971736.853098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971736.853104:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766237056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971736.853112:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971736.853116:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 19 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.853124:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 19 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971736.853133:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971736.853152:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766237056:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971736.853157:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971736.853197:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766236928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971736.853225:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766237056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971736.853233:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766237184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790971736.854533:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc400/0xbd3388eaa6f495ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f495e5 expref: 18 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.854552:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236416:0@lo:104: 00010000:00010000:3.0:1790971736.854565:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002c800/0xbd3388eaa6f495de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f495d7 expref: 17 pid: 5834 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.854574:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236544:0@lo:104: 00010000:00010000:3.0:1790971736.854583:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002d400/0xbd3388eaa6f495d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f495c9 expref: 16 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.854591:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236672:0@lo:104: 00010000:00010000:1.0:1790971736.854693:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971736.861078:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971736.861123:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971736.861149:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745230976 00000100:00100000:0.0:1790971736.861158:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745230976 00010000:00010000:0.0:1790971736.861198:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 13 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971736.861231:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745231104 00000100:00100000:0.0:1790971736.861234:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745231104 00010000:00010000:0.0:1790971736.861250:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 14 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971736.861272:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:0.0:1790971736.861281:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+14:2357:x1877969745230976:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971736.861296:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971736.861315:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 14 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861328:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 14 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861349:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971736.861410:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+14:2357:x1877969745230976:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 130us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971736.861418:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:0.0:1790971736.861446:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1790971736.861452:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745231104:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971736.861461:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971736.861465:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 13 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861499:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 13 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861512:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861521:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861535:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861541:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861557:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861564:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861570:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971736.861574:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861582:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861591:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971736.861600:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971736.861620:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745231104:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 167us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971736.861626:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00010000:00010000:3.0:1790971736.862205:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd43e00/0xbd3388eaa6f49601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a285 expref: 12 pid: 5834 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.862221:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236288:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971736.862234:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd43600/0xbd3388eaa6f495c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a24d expref: 11 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971736.862242:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877969766236800:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971736.862265:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.862273:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.862279:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971736.862285:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4961d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971737.189047:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971738.150890:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971738.150964:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745231232 00000100:00100000:0.0:1790971738.150974:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745231232 00000100:00100000:0.0:1790971738.151028:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:0.0:1790971738.151038:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+11:5596:x1877969745231232:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971738.151056:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971738.151075:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a2af expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.151102:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.151129:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.151139:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbde00, rc 0) 00000100:00100000:0.0:1790971738.151198:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745231232:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 162us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971738.151206:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:0.0:1790971738.157090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971738.157196:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745231360 00000100:00100000:3.0:1790971738.157380:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745231360 00000100:00100000:3.0:1790971738.157552:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:3.0:1790971738.157562:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745231360:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971738.157895:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745231360:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 332us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971738.157903:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:2.0:1790971738.163540:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971738.163631:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745231488 00000100:00100000:0.0:1790971738.163642:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745231488 00000100:00100000:0.0:1790971738.163793:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:0.0:1790971738.163803:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745231488:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.164014:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745231488:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 211us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971738.164022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:1.0:1790971738.177087:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971738.177833:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745231616 00000100:00100000:2.0:1790971738.177843:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745231616 00000100:00100000:2.0:1790971738.177897:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:2.0:1790971738.177906:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745231616:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971738.177923:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971738.177940:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a2b6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.177966:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.177977:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.177986:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d59000, rc 0) 00000100:00100000:2.0:1790971738.178132:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745231616:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 225us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971738.178139:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:1.0:1790971738.190819:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971738.190902:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745231744 00000100:00100000:0.0:1790971738.190912:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745231744 00000100:00100000:0.0:1790971738.191053:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:0.0:1790971738.191063:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745231744:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.191563:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745231744:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 500us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971738.191571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:2.0:1790971738.194103:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971738.194142:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745231872 00000100:00100000:1.0:1790971738.194154:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745231872 00000100:00100000:1.0:1790971738.194208:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00100000:1.0:1790971738.194221:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745231872:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971738.194854:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745231872:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 631us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971738.194864:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 238 00010000:00010000:0.0:1790971738.212919:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790971738.792024:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790971738.792031:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4bfbb1000 from 7 10000000:01000000:2.0:1790971738.792035:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971738.792081:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.792093:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.792105:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971738.792139:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be189500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.792206:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971738.793511:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483d46a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971738.798432:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237312 00000100:00100000:0.0:1790971738.798446:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237312 00000100:00100000:2.0:1790971738.798844:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790971738.798854:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766237312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971738.798871:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971738.798889:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49632 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.798915:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.798935:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.798945:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d59a00, rc 0) 00000100:00100000:2.0:1790971738.799022:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766237312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (6816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971738.799029:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790971738.799329:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be189500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971738.799357:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971738.799366:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971738.799440:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971738.799516:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971738.799542:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886ef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971738.803447:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237440 00000100:00100000:2.0:1790971738.803464:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237440 00000100:00100000:2.0:1790971738.803565:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790971738.803574:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766237440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.803869:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766237440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971738.803877:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790971738.803949:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.803996:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.804178:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971738.804209:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971738.804222:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237568 00000100:00100000:2.0:1790971738.804226:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237568 00000100:00100000:2.0:1790971738.804244:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790971738.804250:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766237568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.804379:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766237568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971738.804386:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790971738.804433:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790971738.809748:0:11224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790971738.813785:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790971738.813820:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971738.813832:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.813845:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971738.813856:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790971738.813859:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4be529000 from 7 10000000:01000000:0.0:1790971738.813861:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790971738.813903:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.813911:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.813934:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971738.813959:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.814023:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971738.814075:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971738.814292:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237696 00000100:00100000:2.0:1790971738.814299:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237696 00000100:00100000:2.0:1790971738.814347:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790971738.814356:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766237696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971738.814370:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971738.814382:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f49640 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.814405:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.814426:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.814452:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58600, rc 0) 00000100:00100000:2.0:1790971738.814531:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766237696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971738.814538:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790971738.816246:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971738.816269:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.816280:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971738.816370:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.816432:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971738.816497:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971738.816517:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237824 00000100:00100000:0.0:1790971738.816523:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237824 00000100:00100000:0.0:1790971738.816557:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790971738.816565:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766237824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.816794:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766237824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971738.816802:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790971738.816837:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.816864:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.816901:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971738.816915:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971738.817025:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766237952 00000100:00100000:1.0:1790971738.817029:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766237952 00000100:00100000:1.0:1790971738.817063:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790971738.817070:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766237952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971738.828871:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766237952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 11790us (11958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971738.828887:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790971738.833619:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766237952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790971738.834869:0:11225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790971738.845860:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790971738.845901:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790971738.845914:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971738.845928:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971738.846059:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790971738.846063:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4b52bc800 from 7 10000000:01000000:2.0:1790971738.846066:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971738.846107:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.846115:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.846126:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971738.846151:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766238080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.846219:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971738.846263:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971738.846312:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238080 00000100:00100000:0.0:1790971738.846320:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238080 00000100:00100000:0.0:1790971738.846372:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790971738.846381:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766238080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971738.846393:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971738.846405:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4964e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.846453:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.846463:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971738.846498:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbcc00, rc 0) 00000100:00100000:0.0:1790971738.846543:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766238080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971738.846549:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790971738.846659:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766238080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971738.846673:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.846681:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971738.846731:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766238208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.846768:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971738.846793:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971738.846834:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238208 00000100:00100000:0.0:1790971738.846838:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238208 00000100:00100000:0.0:1790971738.846868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790971738.846874:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766238208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.847102:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766238208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971738.847109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790971738.847174:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766238208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.847202:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766238336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971738.847241:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971738.847261:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971738.847299:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238336 00000100:00100000:0.0:1790971738.847304:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238336 00000100:00100000:0.0:1790971738.847330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790971738.847337:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766238336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971738.847509:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766238336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971738.847515:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1790971738.847598:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766238336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790971738.848705:0:11226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790971738.848976:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790971738.848997:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790971738.849008:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971738.849019:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971739.236763:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971740.004766:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766238464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971740.004837:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971740.007799:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238464 00000100:00100000:1.0:1790971740.007815:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238464 00000100:00100000:1.0:1790971740.007889:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790971740.007899:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766238464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790971740.007937:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790971740.008001:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971740.008010:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766238464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971740.008017:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1790971740.008128:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4be188a80 x1877969766238464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971740.008149:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766238464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790971740.263589:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971740.516788:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790971740.516810:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766238592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971740.516887:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971740.516957:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238592 00000100:00100000:3.0:1790971740.516965:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238592 00000100:00100000:3.0:1790971740.517029:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790971740.517039:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766238592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971740.517075:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971740.517118:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766238592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971740.517124:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1790971740.517147:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790971740.517177:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd487d86680 x1877969766238592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971740.517194:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766238592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971740.529318:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766238720:0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.529418:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971740.529452:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766239232:0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.529498:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971740.529525:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971740.529530:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766238848:0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.529922:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971740.529956:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238720 00000100:00100000:0.0:1790971740.529963:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238720 00000100:00100000:0.0:1790971740.530001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1790971740.530009:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766238720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.530058:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766238720:12345-0@lo:400:kworker.0 Request processed in 49us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971740.530065:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1790971740.530281:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766239232 00000100:00100000:0.0:1790971740.530286:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766239232 00000100:00100000:0.0:1790971740.530323:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238848 00000100:00100000:0.0:1790971740.530326:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238848 00000100:00100000:0.0:1790971740.530344:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790971740.530349:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766239232:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790971740.530493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971740.530592:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790971740.530600:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766238848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971740.530653:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766238848:12345-0@lo:400:kworker.0 Request processed in 54us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971740.530659:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790971740.530816:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766239104:0@lo:400:kworker.0 00000100:00100000:3.0:1790971740.530857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971740.530879:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971740.530885:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766238976:0@lo:400:kworker.0 00000100:00100000:3.0:1790971740.530906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971740.530947:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766238976 00000100:00100000:3.0:1790971740.530950:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766238976 00000100:00100000:3.0:1790971740.530976:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790971740.530981:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766238976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971740.531014:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766238976:12345-0@lo:400:kworker.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971740.531020:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1790971740.531037:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971740.531062:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766238976:0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.531223:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766239232:12345-0@lo:400:kworker.0 Request processed in 873us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971740.531229:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790971740.531253:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766239104 00000100:00100000:0.0:1790971740.531256:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766239104 00000100:00100000:0.0:1790971740.531277:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790971740.531283:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766239104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.531308:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766239104:12345-0@lo:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971740.531320:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1790971740.531441:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c03e1c00 x1877969766239104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971740.531452:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766239104:0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.531775:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766238848:0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.531793:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766238720:0@lo:400:kworker.0 00000100:00100000:0.0:1790971740.531808:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766239232:0@lo:400:kworker.0 00000100:00100000:3.0:1790971740.583727:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971740.583818:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971740.583842:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971740.583875:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232128 00000100:00100000:3.0:1790971740.583885:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232128 00000100:00100000:1.0:1790971740.583897:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232000 00000100:00100000:1.0:1790971740.583901:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232000 00000100:00100000:3.0:1790971740.583939:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232256 00000100:00100000:3.0:1790971740.583942:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232256 00000100:00100000:1.0:1790971740.583943:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00100000:1.0:1790971740.583952:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745232000:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971740.583959:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:3.0:1790971740.583965:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2354:x1877969745232128:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971740.584030:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:0.0:1790971740.584039:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745232256:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971740.584095:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745232000:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971740.584104:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00100000:3.0:1790971740.584220:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2354:x1877969745232128:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 253us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971740.584227:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00080000:3.0:1790971740.584248:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971740.587381:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745232256:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3333us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971740.587405:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00010000:00010000:1.0:1790971741.292944:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790971741.728445:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790971742.308710:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971743.333972:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971744.356840:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971745.124794:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971745.124817:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766239360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971745.124885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971745.124960:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766239360 00000100:00100000:3.0:1790971745.124968:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766239360 00000100:00100000:3.0:1790971745.125025:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790971745.125034:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766239360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971745.125071:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971745.125117:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766239360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971745.125126:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790971745.125148:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790971745.125193:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4b70c2d80 x1877969766239360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971745.125212:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766239360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790971745.382986:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971745.637708:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766239872:0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.637778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971745.637867:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766239488:0@lo:400:kworker.0 00000100:00100000:0.0:1790971745.637949:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971745.638346:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971745.638355:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766239744:0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.638394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971745.639570:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766239488 00000100:00100000:1.0:1790971745.639583:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766239488 00000100:00100000:1.0:1790971745.639631:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1790971745.639641:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766239488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.639703:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766239488:12345-0@lo:400:kworker.0 Request processed in 64us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971745.639710:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790971745.639832:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766239488:0@lo:400:kworker.0 00000100:00100000:0.0:1790971745.639842:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766240000:0@lo:400:kworker.0 00000100:00100000:0.0:1790971745.639875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971745.640156:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971745.640165:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766239616:0@lo:400:kworker.0 00000100:00100000:0.0:1790971745.640192:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971745.640405:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766239872 00000100:00100000:1.0:1790971745.640411:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766239872 00000100:00100000:1.0:1790971745.640487:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766239744 00000100:00100000:1.0:1790971745.640491:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766239744 00000100:00100000:1.0:1790971745.640507:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766239616 00000100:00100000:1.0:1790971745.640509:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766239616 00000100:00100000:1.0:1790971745.640521:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790971745.640527:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766239872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.640568:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766239872:12345-0@lo:400:kworker.0 Request processed in 42us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971745.640574:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790971745.640585:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790971745.640601:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766239744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.640629:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766239744:12345-0@lo:400:kworker.0 Request processed in 30us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971745.640634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790971745.640644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790971745.640649:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766239616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.640677:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766239616:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971745.640683:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790971745.640718:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766239744:0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.640730:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766239872:0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.640755:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766239616:0@lo:400:kworker.0 00000100:00080000:3.0:1790971745.642826:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971745.642846:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766240128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971745.642912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971745.642960:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240128 00000100:00100000:3.0:1790971745.642966:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240128 00000100:00100000:3.0:1790971745.643011:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790971745.643019:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766240128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971745.643053:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971745.643097:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766240128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971745.643105:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1790971745.643125:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790971745.643150:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd487d85880 x1877969766240128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971745.643171:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766240128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971745.643927:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240000 00000100:00100000:2.0:1790971745.643935:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240000 00000100:00100000:2.0:1790971745.643970:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790971745.643979:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766240000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971745.644034:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766240000:12345-0@lo:400:kworker.0 Request processed in 56us (4157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971745.644041:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1790971745.644074:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4b70c0380 x1877969766240000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971745.644086:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766240000:0@lo:400:kworker.0 00000100:00100000:1.0:1790971745.704058:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971745.704097:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971745.704129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971745.704157:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232640 00000100:00100000:1.0:1790971745.704166:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232640 00000100:00100000:1.0:1790971745.704217:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232512 00000100:00100000:1.0:1790971745.704220:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232512 00000100:00100000:1.0:1790971745.704241:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:1.0:1790971745.704251:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745232640:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971745.704323:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745232640:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971745.704330:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:1.0:1790971745.704347:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:1.0:1790971745.704379:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745232512:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971745.704411:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745232512:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971745.704418:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:0.0:1790971745.704572:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232384 00000100:00100000:0.0:1790971745.704577:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232384 00000100:00100000:0.0:1790971745.704607:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00100000:0.0:1790971745.704614:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745232384:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971745.704642:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745232384:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971745.704656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00080000:3.0:1790971745.704735:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1790971745.705405:0:11466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:09:04 (1790971744) === 00000100:00100000:1.0:1790971745.929829:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971745.929915:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971745.930778:0:5847:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232896 00000100:00100000:3.0:1790971745.930790:0:5847:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232896 00000100:00100000:3.0:1790971745.930847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1790971745.930857:0:5847:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:9690:x1877969745232896:12345-192.168.203.43@tcp:700:mkdir.0 00000100:00100000:3.0:1790971745.930932:0:5847:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:9690:x1877969745232896:12345-192.168.203.43@tcp:700:mkdir.0 Request processed in 76us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971745.930940:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1790971745.934390:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745232768 00000100:00100000:2.0:1790971745.934406:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745232768 00000100:00100000:2.0:1790971745.934595:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1790971745.934607:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745232768:12345-192.168.203.43@tcp:41:mkdir.0 00000004:00000024:2.0:1790971745.934657:0:7888:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790971745.934790:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745232768:12345-192.168.203.43@tcp:41:mkdir.0 Request processed in 185us (4969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971745.934799:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1790971745.940412:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971745.940530:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745233152 00000100:00100000:3.0:1790971745.940550:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745233152 00000100:00100000:3.0:1790971745.940637:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1790971745.940650:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:9690:x1877969745233152:12345-192.168.203.43@tcp:36:mkdir.0 00010000:00010000:3.0:1790971745.940726:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971745.940856:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4953d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a238 expref: 6 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.940885:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971745.940900:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971745.941331:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.941350:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.941466:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.941530:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.941539:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.941546:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971745.946413:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790971745.946440:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971745.946452:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971745.946460:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971745.946466:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971745.946516:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971745.946524:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971745.946543:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040200) 00010000:00010000:2.0:1790971745.946546:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971745.946550:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971745.946563:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4965c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790971745.946585:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009068ff18 reply state 00000000b300d2db transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971745.946593:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971745.946764:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9690:x1877969745233152:12345-192.168.203.43@tcp:36:mkdir.0 Request processed in 6113us (6358us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790971745.946773:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:1.0:1790971745.950744:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.950762:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.950770:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.950776:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971745.950786:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.950793:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.950812:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cd483040500) 00010000:00010000:1.0:1790971745.950815:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971745.950820:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.950826:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49663 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971745.962605:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971745.966827:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745233280 00000100:00100000:3.0:1790971745.966849:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745233280 00000100:00100000:3.0:1790971745.967013:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1790971745.967038:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:9692:x1877969745233280:12345-192.168.203.43@tcp:101:chmod.0 00010000:00010000:3.0:1790971745.967070:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971745.967105:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4966a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.967221:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49671 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.967238:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.967252:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971745.967297:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790971745.967301:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971745.967372:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.967413:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4966a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2bd expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.967435:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49671 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2bd expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.967444:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971745.967447:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971745.967451:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c600, rc 0) 00000100:00100000:3.0:1790971745.967614:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9692:x1877969745233280:12345-192.168.203.43@tcp:101:chmod.0 Request processed in 591us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971745.967623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1790971745.978776:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971745.986534:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745233536 00000100:00100000:0.0:1790971745.986554:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745233536 00000100:00100000:1.0:1790971745.986750:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1790971745.986763:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9692:x1877969745233536:12345-192.168.203.43@tcp:36:chmod.0 00010000:00010000:1.0:1790971745.986837:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971745.986870:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49671 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2bd expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.986895:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971745.986908:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971745.986939:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.986955:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971745.986966:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790971745.987324:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003b47e206 reply state 0000000032145d61 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971745.987335:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790971745.987345:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790971745.987552:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:9692:x1877969745233536:12345-192.168.203.43@tcp:36:chmod.0 Request processed in 789us (8790us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790971745.987560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00010000:00010000:3.0:1790971745.989849:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.989886:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.989894:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.989901:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971745.989907:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.989915:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.989934:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971745.989938:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790971745.989943:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971745.989950:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43a00/0xbd3388eaa6f49678 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971746.017767:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971746.017963:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745233664 00000100:00100000:2.0:1790971746.017977:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745233664 00000100:00100000:2.0:1790971746.018052:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1790971746.018065:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9693:x1877969745233664:12345-192.168.203.43@tcp:101:chown.0 00010000:00010000:2.0:1790971746.018108:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971746.018139:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4967f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2c4 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.018226:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f49686 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.018245:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f49686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.018260:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f49686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971746.018308:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790971746.018313:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971746.018394:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f49686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.018436:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4967f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2c4 expref: 9 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.018467:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f49686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2c4 expref: 8 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.018854:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd4a656c700) 00010000:00010000:2.0:1790971746.018858:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790971746.018862:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d59e00, rc 0) 00000100:00100000:0.0:1790971746.019987:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:9693:x1877969745233664:12345-192.168.203.43@tcp:101:chown.0 Request processed in 1913us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971746.020001:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1790971746.023763:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971746.023896:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745233792 00000100:00100000:3.0:1790971746.023912:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745233792 00000100:00100000:3.0:1790971746.024024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1790971746.024034:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:9693:x1877969745233792:12345-192.168.203.43@tcp:101:chown.0 00010000:00010000:3.0:1790971746.024063:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971746.024107:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4968d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2cb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024223:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024241:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024255:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024271:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024279:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024285:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024425:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f496a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024433:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f496a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024439:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f496a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971746.024505:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790971746.024509:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971746.024537:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f496a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024563:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024570:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024579:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024586:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971746.024592:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024601:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024617:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd4a656c700) 00010000:00010000:3.0:1790971746.024620:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971746.024627:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024634:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024648:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024655:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024662:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024673:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971746.024676:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024683:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024690:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cd483040800) 00010000:00010000:3.0:1790971746.024692:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971746.024694:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024700:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4969b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024741:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4968d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2cb expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024756:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f496a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2cb expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.024763:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd483040700) 00010000:00010000:3.0:1790971746.024766:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971746.024768:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d800, rc 0) 00000100:00100000:3.0:1790971746.024879:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:9693:x1877969745233792:12345-192.168.203.43@tcp:101:chown.0 Request processed in 845us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971746.024887:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1790971746.033380:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.033591:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745234048 00000100:00100000:1.0:1790971746.033611:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745234048 00000100:00100000:1.0:1790971746.033689:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1790971746.033701:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:9693:x1877969745234048:12345-192.168.203.43@tcp:36:chown.0 00010000:00010000:1.0:1790971746.033779:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971746.033815:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f496a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2cb expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.033839:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd483040700) 00010000:00010000:1.0:1790971746.033852:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971746.033885:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.033901:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.033912:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971746.064835:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1790971746.064935:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d4b5dd0b reply state 00000000f5b9c38a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971746.064949:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790971746.064962:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1790971746.065075:0:5839:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790971746.065098:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9693:x1877969745234048:12345-192.168.203.43@tcp:36:chown.0 Request processed in 31393us (31738us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790971746.065109:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:1.0:1790971746.065610:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.065622:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.065630:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.065636:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971746.065641:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.065667:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.065683:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd48dd1b400) 00010000:00010000:1.0:1790971746.065686:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790971746.065690:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.065697:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971746.097395:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971746.106707:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745234176 00000100:00100000:2.0:1790971746.106823:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745234176 00000100:00100000:2.0:1790971746.106917:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1790971746.106928:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:9694:x1877969745234176:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:2.0:1790971746.106966:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971746.106996:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f496b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2d2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790971746.112288:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5215us 00010000:00010000:2.0:1790971746.131587:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.131623:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.131638:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.131670:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.131678:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.131686:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132144:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59c00/0xbd3388eaa6f496c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132154:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59c00/0xbd3388eaa6f496c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132163:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59c00/0xbd3388eaa6f496c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971746.132189:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790971746.132194:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971746.132242:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59c00/0xbd3388eaa6f496c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132258:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132267:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132275:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132293:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d59200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971746.132299:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132309:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132563:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd4a656c700) 00010000:00010000:2.0:1790971746.132567:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971746.132573:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132581:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59200/0xbd3388eaa6f496b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132604:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132611:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132617:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132622:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d59800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971746.132625:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132630:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132650:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cd4a656cd00) 00010000:00010000:2.0:1790971746.132653:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971746.132656:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132662:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59800/0xbd3388eaa6f496be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132711:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f496b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2d2 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132729:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59c00/0xbd3388eaa6f496c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2d2 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.132736:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:2.0:1790971746.132738:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790971746.132740:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d59c00, rc 0) 00000100:00100000:2.0:1790971746.132845:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9694:x1877969745234176:12345-192.168.203.43@tcp:101:touch.500 Request processed in 25917us (35691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971746.132856:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1790971746.140898:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.142291:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745234432 00000100:00100000:1.0:1790971746.142307:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745234432 00000100:00100000:1.0:1790971746.142413:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1790971746.142425:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9694:x1877969745234432:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:1.0:1790971746.142455:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971746.142528:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2d9 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.142871:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.142889:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.142902:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.142918:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.142934:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.142941:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790971746.143874:0:7888:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790971746.144198:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f496e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144211:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f496e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144221:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f496e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144264:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144273:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144280:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144286:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971746.144291:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144300:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144324:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:1.0:1790971746.144328:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971746.144333:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144341:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f496d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790971746.144369:0:7888:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000d38b06b reply state 00000000a1d586d4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971746.144379:0:7888:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790971746.144423:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f496cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2d9 expref: 10 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144439:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f496e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2d9 expref: 9 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.144446:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971746.144448:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790971746.144451:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42400, rc 0) 00000100:00100000:1.0:1790971746.144583:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:9694:x1877969745234432:12345-192.168.203.43@tcp:101:touch.500 Request processed in 2160us (3698us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790971746.144594:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00010000:00010000:3.0:1790971746.147052:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.147088:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.147098:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.147105:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971746.147111:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.147121:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.147141:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff8cd48dd1b400) 00010000:00010000:3.0:1790971746.147144:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971746.147150:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.147192:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42c00/0xbd3388eaa6f496da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971746.152135:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.152560:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745234688 00000100:00100000:1.0:1790971746.152573:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745234688 00000100:00100000:1.0:1790971746.152643:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1790971746.152654:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:9694:x1877969745234688:12345-192.168.203.43@tcp:36:touch.500 00010000:00010000:1.0:1790971746.152751:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971746.152782:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f496e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2d9 expref: 9 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.152808:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971746.152821:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971746.152869:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.152884:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.152895:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790971746.153057:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe0c839c reply state 0000000036bab14b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971746.153067:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790971746.153363:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:9694:x1877969745234688:12345-192.168.203.43@tcp:36:touch.500 Request processed in 701us (1233us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790971746.153372:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1790971746.160706:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:1.0:1790971746.161146:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161170:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161179:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161208:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971746.161214:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161224:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161244:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b300) 00010000:00010000:1.0:1790971746.161247:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971746.161252:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161259:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f496ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971746.161312:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745234816 00000100:00100000:1.0:1790971746.161333:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745234816 00000100:00100000:1.0:1790971746.161406:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1790971746.161417:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:9694:x1877969745234816:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:1.0:1790971746.161448:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971746.161486:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f496f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2e0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161556:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f496f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2e0 expref: 10 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161571:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f496f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2e0 expref: 10 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.161602:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971746.161605:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790971746.161608:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43400, rc 0) 00000100:00100000:1.0:1790971746.161689:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:9694:x1877969745234816:12345-192.168.203.43@tcp:101:touch.500 Request processed in 274us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971746.161697:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1790971746.171125:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971746.171528:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745234944 00000100:00100000:0.0:1790971746.171541:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745234944 00000100:00100000:0.0:1790971746.171606:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1790971746.171617:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877969745234944:12345-192.168.203.43@tcp:8:touch.500 00010000:00080000:0.0:1790971746.171670:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:0.0:1790971746.171723:0:6690:0:(genops.c:1384:class_connect()) connect: client aa9b9adf-df76-49fe-88a5-1de8c4d3a597, cookie 0xbd3388eaa6f496fd 00002000:00100000:0.0:1790971746.171743:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa9b9adf-df76-49fe-88a5-1de8c4d3a597/ffff8cd386fa9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790971746.171759:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790971746.172092:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790971746.172133:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cd386fa8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971746.172232:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2353:x1877969745234944:12345-192.168.203.43@tcp:8:touch.500 Request processed in 615us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971746.172242:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1790971746.176150:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971746.176253:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745235072 00000100:00100000:0.0:1790971746.176266:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745235072 00000100:00100000:0.0:1790971746.176368:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1790971746.176380:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:0:x1877969745235072:12345-192.168.203.43@tcp:2:touch.500 00000100:00080000:3.0:1790971746.177128:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1790971746.281824:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1790971746.281844:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000100:00100000:2.0:1790971746.282809:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:0:x1877969745235072:12345-192.168.203.43@tcp:2:touch.500 Request processed in 106423us (106666us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790971746.282820:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1790971746.286911:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971746.287007:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745235328 00000100:00100000:2.0:1790971746.287017:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745235328 00000100:00100000:2.0:1790971746.287077:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1790971746.287100:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:9694:x1877969745235328:12345-192.168.203.43@tcp:35:touch.500 00000100:00100000:2.0:1790971746.287459:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:9694:x1877969745235328:12345-192.168.203.43@tcp:35:touch.500 Request processed in 359us (557us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790971746.287467:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:3.0:1790971746.316109:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.316202:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745235456 00000100:00100000:1.0:1790971746.316211:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745235456 00000100:00100000:1.0:1790971746.316270:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:1.0:1790971746.316279:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:9695:x1877969745235456:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:1.0:1790971746.316304:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971746.316342:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.316418:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f4970b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.316431:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f4970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.316442:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f4970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971746.316527:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790971746.316531:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971746.316570:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f4970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.316611:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2e7 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.316628:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f4970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2e7 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.316636:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:1.0:1790971746.316639:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971746.316642:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43e00, rc 0) 00000100:00100000:1.0:1790971746.316707:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:9695:x1877969745235456:12345-192.168.203.43@tcp:101:rm.0 Request processed in 429us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971746.316714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1790971746.327278:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.327397:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745235712 00000100:00100000:1.0:1790971746.327407:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745235712 00000100:00100000:1.0:1790971746.327464:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1790971746.327509:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:9695:x1877969745235712:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:1.0:1790971746.327532:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971746.327553:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2ee expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971746.327656:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790971746.327807:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49712 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2ee expref: 14 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.327821:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd4a656c700) 00010000:00010000:1.0:1790971746.327824:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790971746.327842:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2ee expref: 14 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.327858:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43c00, rc 0) 00000100:00100000:1.0:1790971746.327933:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:9695:x1877969745235712:12345-192.168.203.43@tcp:101:rm.0 Request processed in 461us (664us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1790971746.327941:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1790971746.339998:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971746.340091:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745235840 00000100:00100000:2.0:1790971746.340101:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745235840 00000100:00100000:2.0:1790971746.340169:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1790971746.340180:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:9695:x1877969745235840:12345-192.168.203.43@tcp:37:rm.0 00000100:00100000:1.0:1790971746.349195:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:9695:x1877969745235840:12345-192.168.203.43@tcp:37:rm.0 Request processed in 9008us (9195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971746.349210:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:3.0:1790971746.359696:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.361075:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745236096 00000100:00100000:1.0:1790971746.361089:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745236096 00000100:00100000:1.0:1790971746.361180:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:1.0:1790971746.361192:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4832d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:9695:x1877969745236096:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:1.0:1790971746.361534:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4832d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:9695:x1877969745236096:12345-192.168.203.43@tcp:35:rm.0 Request processed in 344us (1846us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790971746.361542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1790971746.370371:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.370749:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745236352 00000100:00100000:1.0:1790971746.370758:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745236352 00000100:00100000:1.0:1790971746.370819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1790971746.370830:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:9695:x1877969745236352:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:1.0:1790971746.370855:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971746.370887:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.370978:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49727 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.371010:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.371021:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49727 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971746.371034:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790971746.371166:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2f5 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.371187:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49727 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2f5 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.371197:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:1.0:1790971746.371200:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790971746.371203:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43600, rc 0) 00000100:00100000:1.0:1790971746.371264:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:9695:x1877969745236352:12345-192.168.203.43@tcp:101:rm.0 Request processed in 436us (910us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790971746.371272:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1790971746.380240:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971746.380419:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745236480 00000100:00100000:2.0:1790971746.380428:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745236480 00000100:00100000:2.0:1790971746.380513:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1790971746.380524:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:9695:x1877969745236480:12345-192.168.203.43@tcp:41:rm.0 00000004:00000024:2.0:1790971746.380580:0:5840:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1790971746.380643:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:9695:x1877969745236480:12345-192.168.203.43@tcp:41:rm.0 Request processed in 121us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971746.380651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1790971746.389369:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971746.389657:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745236608 00000100:00100000:3.0:1790971746.389666:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745236608 00000100:00100000:3.0:1790971746.389715:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1790971746.389725:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:9695:x1877969745236608:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:3.0:1790971746.389745:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971746.389765:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49735 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a2fc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.389824:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.389839:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.389850:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.389863:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.389897:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.389905:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390017:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4974a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390027:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4974a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390034:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4974a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971746.390062:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790971746.390066:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971746.390086:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4974a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390097:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4974a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390105:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390112:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390119:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390135:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971746.390140:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390148:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390160:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:3.0:1790971746.390163:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971746.390167:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390173:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4973c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390184:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390190:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390196:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390200:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971746.390203:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390208:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390226:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff8cd483040300) 00010000:00010000:3.0:1790971746.390229:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971746.390232:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390237:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390268:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49735 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390281:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4974a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2fc expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.390288:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971746.390291:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971746.390293:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00000100:00100000:3.0:1790971746.390378:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:9695:x1877969745236608:12345-192.168.203.43@tcp:101:rm.0 Request processed in 653us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971746.390385:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1790971746.396350:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.396688:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745236864 00000100:00100000:1.0:1790971746.396698:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745236864 00000100:00100000:1.0:1790971746.396761:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1790971746.396771:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:9695:x1877969745236864:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:1.0:1790971746.396835:0:7888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790971746.396877:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4974a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2fc expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.396932:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f496f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2e0 expref: 16 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.396945:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971746.396963:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f4970b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2e7 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.396972:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:1.0:1790971746.396976:0:7888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971746.396999:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397013:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397023:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397040:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397046:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397053:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397152:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397435:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.397442:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790971746.398530:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1790971746.398542:0:7888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325338070816ns, next at 326338068568ns, rc = 0 00010000:00010000:0.0:1790971746.398606:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398620:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398629:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398637:0:7888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398645:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398652:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398671:0:7888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971746.398693:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398700:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398706:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398718:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971746.398723:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398732:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398743:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971746.398746:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790971746.398750:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398757:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4975f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398776:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398782:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398789:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398794:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971746.398797:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398803:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398820:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:0.0:1790971746.398822:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971746.398826:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.398832:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49751 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971746.398843:0:7888:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c864c865 reply state 00000000eeddeceb transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971746.398851:0:7888:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971746.398941:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:9695:x1877969745236864:12345-192.168.203.43@tcp:36:rm.0 Request processed in 2169us (2599us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790971746.398951:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00010000:00010000:1.0:1790971746.399773:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971746.399782:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.399791:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971746.399794:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.399825:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.399837:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971746.399840:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790971746.399844:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.399857:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49766 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.399876:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971746.399877:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971746.399896:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971746.403705:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.403722:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.403730:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.403754:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971746.403760:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.403769:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.403784:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff8cd48dd1b300) 00010000:00010000:3.0:1790971746.403787:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971746.403792:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.403799:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49758 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971746.404681:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971746.405751:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971746.405877:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745237120 00000100:00100000:1.0:1790971746.405888:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745237120 00000100:00100000:1.0:1790971746.405946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1790971746.405954:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:9695:x1877969745237120:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:1.0:1790971746.406177:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:9695:x1877969745237120:12345-192.168.203.43@tcp:35:rm.0 Request processed in 222us (431us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790971746.406185:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1790971746.409961:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971746.410030:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745237376 00000100:00100000:3.0:1790971746.410040:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745237376 00000100:00100000:3.0:1790971746.410096:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:3.0:1790971746.410106:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:9695:x1877969745237376:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:3.0:1790971746.410168:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790971746.410196:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2f5 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410220:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59c00/0xbd3388eaa6f496c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2d2 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410236:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:3.0:1790971746.410251:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f49686 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2c4 expref: 14 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410276:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd4a656c700) 00010000:00010000:3.0:1790971746.410282:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971746.410303:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410393:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410405:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410419:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410426:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971746.410432:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.411849:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.411968:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.411981:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971746.412792:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790971746.412815:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.412824:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.412830:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.412836:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971746.412841:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.412848:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.412860:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cd4a656ca00) 00010000:00010000:2.0:1790971746.412863:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790971746.414225:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414240:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4977b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414277:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414284:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414290:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414295:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971746.414444:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414453:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414466:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040300) 00010000:00010000:2.0:1790971746.414519:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971746.414524:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971746.414530:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4976d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790971746.414545:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ac546b7 reply state 0000000036068074 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971746.414554:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971746.414654:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:9695:x1877969745237376:12345-192.168.203.43@tcp:36:rm.0 Request processed in 4545us (4699us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790971746.414663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00010000:00010000:0.0:1790971746.426166:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.426184:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.426192:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.426198:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971746.426203:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.426211:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.426241:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cd483040800) 00010000:00010000:0.0:1790971746.426244:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971746.426249:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971746.426255:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49774 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971747.430936:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971748.452682:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971749.479784:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971750.245681:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766240256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971750.245745:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971750.245875:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240256 00000100:00100000:3.0:1790971750.245883:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240256 00000100:00100000:3.0:1790971750.245935:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790971750.245944:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766240256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971750.245990:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971750.246033:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766240256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971750.246050:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1790971750.246071:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790971750.246097:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cdf80 x1877969766240256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971750.246113:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766240256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790971750.501630:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790971750.633393:0:11617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1790971750.757661:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766240640:0@lo:400:kworker.0 00000100:00100000:1.0:1790971750.757788:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971750.757848:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790971750.757856:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766240512:0@lo:400:kworker.0 00000100:00100000:1.0:1790971750.757880:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971750.757910:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240640 00000100:00100000:1.0:1790971750.757917:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240640 00000100:00100000:0.0:1790971750.758121:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766240384:0@lo:400:kworker.0 00000100:00100000:0.0:1790971750.758159:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971750.758182:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766240896:0@lo:400:kworker.0 00000100:00100000:0.0:1790971750.758206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971750.758227:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790971750.758233:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766240768:0@lo:400:kworker.0 00000100:00100000:0.0:1790971750.758257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971750.758293:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240512 00000100:00100000:0.0:1790971750.758296:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240512 00000100:00100000:1.0:1790971750.758344:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240768 00000100:00100000:1.0:1790971750.758348:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240768 00000004:00080000:3.0:1790971750.761607:0:8041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329701134568ns, next at 330701132010ns, rc = 0 00000100:00100000:3.0:1790971750.761657:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971750.761675:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766241024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971750.761864:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790971750.761879:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766240640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971750.761940:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766240640:12345-0@lo:400:kworker.0 Request processed in 67us (4152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971750.761948:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790971750.761982:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790971750.761988:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766240512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971750.762019:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766240512:12345-0@lo:400:kworker.0 Request processed in 31us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971750.762040:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790971750.762063:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240384 00000100:00100000:0.0:1790971750.762071:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240384 00000100:00100000:0.0:1790971750.762101:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790971750.762107:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766240384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971750.762140:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766240384:12345-0@lo:400:kworker.0 Request processed in 34us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971750.762145:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790971750.762173:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766240896 00000100:00100000:0.0:1790971750.762176:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766240896 00000100:00100000:0.0:1790971750.762203:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790971750.762209:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766240896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971750.762235:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766240896:12345-0@lo:400:kworker.0 Request processed in 27us (4029us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971750.762240:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790971750.762413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971750.762463:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766240512:0@lo:400:kworker.0 00000100:00100000:3.0:1790971750.762496:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766240640:0@lo:400:kworker.0 00000100:00100000:3.0:1790971750.762547:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766241024 00000100:00100000:3.0:1790971750.762550:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766241024 00000100:00100000:3.0:1790971750.762577:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790971750.762583:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766241024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971750.762624:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971750.762663:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766241024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971750.762670:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790971750.762874:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766240384:0@lo:400:kworker.0 00010000:00080000:0.0:1790971750.762888:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd386c8ea00 x1877969766240896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971750.762899:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766240896:0@lo:400:kworker.0 00000100:00080000:0.0:1790971750.763063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971750.763069:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971750.763179:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790971750.763190:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766240768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971750.763267:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766240768:12345-0@lo:400:kworker.0 Request processed in 79us (5008us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971750.763274:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790971750.763386:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766240768:0@lo:400:kworker.0 00010000:00080000:3.0:1790971750.765566:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cdf80 x1877969766241024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971750.765592:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766241024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971750.825594:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971750.825650:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971750.825683:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971750.825709:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971750.825709:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745237760 00000100:00100000:0.0:1790971750.825718:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745237760 00000100:00100000:2.0:1790971750.825729:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745237632 00000100:00100000:2.0:1790971750.825731:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745237632 00000100:00100000:2.0:1790971750.825769:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745237888 00000100:00100000:2.0:1790971750.825772:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745237888 00000100:00100000:0.0:1790971750.825774:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1790971750.825781:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2354:x1877969745237760:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971750.825788:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:2.0:1790971750.825800:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:2354:x1877969745237632:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971750.825877:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745237504 00000100:00100000:3.0:1790971750.825887:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745237504 00000100:00100000:3.0:1790971750.825916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:3.0:1790971750.825922:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745237504:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971750.825976:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:2354:x1877969745237632:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 175us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971750.825984:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:2.0:1790971750.826002:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:2.0:1790971750.826009:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745237888:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971750.829408:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745237504:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3482us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971750.829408:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2354:x1877969745237760:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3615us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971750.829423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:0.0:1790971750.829423:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00080000:0.0:1790971750.829480:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971750.829487:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971750.831275:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745237888:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 5256us (5555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971750.831289:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000001:00080000:2.0:1790971751.406527:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1790971751.406541:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1790971751.406557:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1790971751.406574:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1790971751.406580:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1790971751.406920:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971751.406941:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766241152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790971751.407033:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971751.407558:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766241152 00000100:00100000:3.0:1790971751.407568:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766241152 00000100:00100000:3.0:1790971751.407639:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790971751.407649:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766241152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790971751.407676:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1790971751.407711:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6ac00f62, atime: 0x6ac00f62, ctime: 0x6ac00f62, blocks: 0x1 00010000:00010000:3.0:1790971751.407720:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.407736:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1790971751.407741:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971751.407747:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.407765:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.407775:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.407784:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.407807:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790971751.408375:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766241152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 726us (1340us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790971751.408384:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790971751.411077:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971751.411091:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.411105:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971751.411110:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.411132:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.411158:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.411165:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a1c949/0xbd3388eaa6f49782 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.411192:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971751.411193:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971751.411195:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790971751.411243:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4c02cdf80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1790971751.411250:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766241152:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790971751.527889:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790971751.630938:0:11666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1dc09af0 20000000:00000080:2.0:1790971751.630954:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cd3859ecc00 uarg=0000000000000000 20000000:01000000:2.0:1790971751.630990:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1790971751.630996:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1790971751.631000:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790971751.637179:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1790971751.640351:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1790971751.655917:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1790971751.655979:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1790971751.656040:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1790971751.656062:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790971751.656082:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656103:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656112:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656121:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656127:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656135:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656143:0:11666:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656196:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656209:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 18 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.656224:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241280:0@lo:104: 00000100:00100000:3.0:1790971751.656280:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971751.656349:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656359:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 18 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.656368:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241408:0@lo:104: 00000100:00100000:3.0:1790971751.656392:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971751.656424:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656432:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 18 pid: 5834 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.656440:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241536:0@lo:104: 00000100:00100000:3.0:1790971751.656462:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971751.656531:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656541:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 12 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.656565:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241664:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971751.656574:0:5822:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790971751.656590:0:5822:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766241280 00000100:00100000:2.0:1790971751.656599:0:5822:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766241280 00010000:00010000:3.0:1790971751.656633:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.656642:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 12 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.656651:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241792:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971751.656673:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21840 going to sleep for 11 seconds 00000100:00100000:1.0:1790971751.656938:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766241408 00000100:00100000:1.0:1790971751.656944:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766241408 00000100:00100000:1.0:1790971751.656975:0:5823:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766241536 00000100:00100000:1.0:1790971751.656979:0:5823:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766241536 00000100:00100000:1.0:1790971751.656994:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790971751.657003:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+5:11666:x1877969766241408:12345-0@lo:104: 00010000:00010000:1.0:1790971751.657015:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657079:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790971751.657086:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+5:11666:x1877969766241408:12345-0@lo:104: Request processed in 85us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971751.657094:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790971751.657112:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790971751.657119:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:11666:x1877969766241536:12345-0@lo:104: 00010000:00010000:0.0:1790971751.657122:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971751.657128:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657132:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657144:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc600 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971751.657149:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657159:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971751.657166:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657171:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1790971751.657173:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1790971751.657179:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+4:11666:x1877969766241536:12345-0@lo:104: Request processed in 59us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971751.657186:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790971751.657200:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971751.657207:0:5823:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:11666:x1877969766241280:12345-0@lo:104: 00010000:00010000:0.0:1790971751.657208:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657217:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657218:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971751.657242:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657249:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc600/0xbd3388eaa6f49640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49647 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657257:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790971751.657266:0:5823:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+3:11666:x1877969766241280:12345-0@lo:104: Request processed in 59us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971751.657283:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790971751.657326:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971751.657336:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766241920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790971751.657350:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790971751.657356:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657364:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d58000 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971751.657368:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971751.657374:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790971751.657384:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971751.657392:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971751.657399:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790971751.657406:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971751.657412:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657418:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657420:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d58800 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:1.0:1790971751.657426:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657429:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971751.657439:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657445:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971751.657447:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971751.657464:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790971751.657466:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd487d58000/0xbd3388eaa6f49632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49639 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.657507:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971751.657509:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971751.657511:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971751.657516:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657524:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971751.657548:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657554:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd487d58800/0xbd3388eaa6f4964e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f49655 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657568:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971751.657575:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971751.657577:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971751.657588:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766241920 00000100:00100000:1.0:1790971751.657592:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766241920 00010000:00010000:1.0:1790971751.657609:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 19 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971751.657630:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790971751.657636:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766241920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971751.657645:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971751.657649:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 19 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657657:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 19 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657671:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971751.657696:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766241920:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971751.657702:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790971751.657737:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790971751.657745:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766242176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971751.657770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971751.657802:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242176 00000100:00100000:1.0:1790971751.657805:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242176 00010000:00010000:1.0:1790971751.657832:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 19 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971751.657852:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790971751.657858:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766242176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971751.657872:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971751.657876:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 19 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657886:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 19 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.657895:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971751.657923:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766242176:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971751.657928:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790971751.657968:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766242176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971751.657989:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766242048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971751.658011:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971751.658030:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766241920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971751.658049:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242048 00000100:00100000:1.0:1790971751.658052:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242048 00010000:00010000:1.0:1790971751.658064:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 19 pid: 5834 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971751.658080:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790971751.658086:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b5251050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766242048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971751.658093:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971751.658096:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 19 pid: 5834 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.658106:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 19 pid: 5834 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971751.658122:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971751.658150:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b5251050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766242048:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971751.658156:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790971751.658197:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766242048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790971751.658440:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971751.660611:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbcc00/0xbd3388eaa6f49655 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4964e expref: 18 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.660631:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241280:0@lo:104: 00010000:00010000:3.0:1790971751.660643:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d58600/0xbd3388eaa6f49647 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49640 expref: 17 pid: 5831 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.660655:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241408:0@lo:104: 00010000:00010000:3.0:1790971751.660665:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d59a00/0xbd3388eaa6f49639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f49632 expref: 16 pid: 5834 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.660677:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241536:0@lo:104: 00000100:00100000:3.0:1790971751.662496:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241664:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971751.662520:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877969766241792:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971751.662566:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971751.662793:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971751.662833:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971751.662910:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238016 00000100:00100000:0.0:1790971751.662924:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238016 00010000:00010000:0.0:1790971751.662960:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 13 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971751.662993:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238144 00000100:00100000:0.0:1790971751.662997:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238144 00010000:00010000:0.0:1790971751.663010:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 14 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971751.663034:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1790971751.663044:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6100ea-73af-4d7b-ad21-580f22f81181+14:2356:x1877969745238016:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971751.663059:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971751.663066:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 14 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.663078:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 14 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971751.663099:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d59000/0xbd3388eaa6f4962b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2b6 expref: 14 pid: 5832 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971751.663106:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00010000:00010000:0.0:1790971751.663123:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971751.663130:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745238144:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971751.663142:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971751.663149:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 13 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663159:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 13 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663172:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbde00/0xbd3388eaa6f49624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a2af expref: 13 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971751.663178:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745238016:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 133us (385us total) trans 0 rc 0/0 00010000:00010000:3.0:1790971751.663187:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971751.663190:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00010000:00010000:3.0:1790971751.663201:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663216:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663223:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663229:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663236:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663253:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002dc00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971751.663258:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663266:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663290:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663300:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971751.663349:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+11:2356:x1877969745238144:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 233us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971751.663357:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00010000:00010000:3.0:1790971751.663384:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663391:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971751.663397:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f49789 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971752.549075:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971753.381990:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971753.382086:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238272 00000100:00100000:0.0:1790971753.382106:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238272 00000100:00100000:0.0:1790971753.382169:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:0.0:1790971753.382179:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+11:5596:x1877969745238272:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971753.382204:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971753.382224:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a303 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971753.382263:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a303 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971753.382275:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a303 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971753.382285:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc600, rc 0) 00000100:00100000:0.0:1790971753.382365:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745238272:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 187us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.382372:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:0.0:1790971753.387056:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971753.387619:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238400 00000100:00100000:2.0:1790971753.387631:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238400 00000100:00100000:2.0:1790971753.387687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 255 00000100:00100000:2.0:1790971753.387702:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745238400:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971753.389270:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745238400:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 1565us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971753.389282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 255 00000100:00100000:1.0:1790971753.401955:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971753.402125:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238528 00000100:00100000:3.0:1790971753.402136:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238528 00000100:00100000:3.0:1790971753.402193:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 256 00000100:00100000:3.0:1790971753.402203:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745238528:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.402449:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745238528:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 246us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971753.402464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 256 00000100:00100000:1.0:1790971753.410971:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971753.411758:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238656 00000100:00100000:2.0:1790971753.411769:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238656 00000100:00100000:2.0:1790971753.411824:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 257 00000100:00100000:2.0:1790971753.411833:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:9965:x1877969745238656:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790971753.412821:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:9965:x1877969745238656:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 982us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971753.412831:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 257 00000100:00100000:2.0:1790971753.424344:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971753.426228:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238784 00000100:00100000:0.0:1790971753.426243:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238784 00000100:00100000:0.0:1790971753.426329:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 258 00000100:00100000:0.0:1790971753.426339:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:9965:x1877969745238784:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790971753.426635:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:9965:x1877969745238784:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 297us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.426644:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 258 00000100:00100000:1.0:1790971753.439437:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971753.439627:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745238912 00000100:00100000:2.0:1790971753.439637:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745238912 00000100:00100000:2.0:1790971753.439693:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 259 00000100:00100000:2.0:1790971753.439713:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+12:5596:x1877969745238912:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971753.439742:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971753.439759:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5e200/0xbd3388eaa6f49797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a30a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971753.439789:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5e200/0xbd3388eaa6f49797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a30a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971753.439801:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5e200/0xbd3388eaa6f49797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a30a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971753.439826:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e200, rc 0) 00000100:00100000:2.0:1790971753.439884:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745238912:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 182us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971753.439891:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 259 00000100:00100000:1.0:1790971753.456403:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971753.456915:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239040 00000100:00100000:2.0:1790971753.456926:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239040 00000100:00100000:2.0:1790971753.457089:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 260 00000100:00100000:2.0:1790971753.457101:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745239040:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971753.457395:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745239040:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 296us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971753.457403:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 260 00000100:00100000:3.0:1790971753.473071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971753.474216:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239168 00000100:00100000:0.0:1790971753.474232:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239168 00000100:00100000:0.0:1790971753.474682:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 261 00000100:00100000:0.0:1790971753.474695:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745239168:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971753.475379:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:5596:x1877969745239168:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 682us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.475392:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 261 00000100:00100000:1.0:1790971753.479872:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971753.480547:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239296 00000100:00100000:2.0:1790971753.480563:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239296 00000100:00100000:2.0:1790971753.480717:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 262 00000100:00100000:2.0:1790971753.480728:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:9968:x1877969745239296:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790971753.481074:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:9968:x1877969745239296:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 346us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971753.481084:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 262 00000100:00100000:1.0:1790971753.493212:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971753.495860:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239424 00000100:00100000:0.0:1790971753.495876:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239424 00000100:00100000:0.0:1790971753.495970:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 263 00000100:00100000:0.0:1790971753.495980:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:9968:x1877969745239424:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790971753.496247:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:9968:x1877969745239424:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 268us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.496256:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 263 00010000:00010000:1.0:1790971753.572692:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790971753.700840:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790971753.700848:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4bfbb1000 from 7 10000000:01000000:2.0:1790971753.700853:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971753.700904:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971753.700917:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971753.700943:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971753.700967:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790971753.701038:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971753.701104:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483d46b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971753.702668:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242304 00000100:00100000:1.0:1790971753.702682:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242304 00000100:00100000:1.0:1790971753.702744:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790971753.702753:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+16:5836:x1877969766242304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971753.702770:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971753.702800:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43a00/0xbd3388eaa6f497a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4979e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971753.702837:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43a00/0xbd3388eaa6f497a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4979e expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971753.702849:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43a00/0xbd3388eaa6f497a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4979e expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971753.702857:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43a00, rc 0) 00000100:00100000:1.0:1790971753.702936:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766242304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971753.702943:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790971753.704708:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971753.704737:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971753.704747:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971753.704822:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971753.704875:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971753.704918:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483d46b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971753.704926:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242432 00000100:00100000:0.0:1790971753.704932:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242432 00000100:00100000:0.0:1790971753.704976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790971753.704984:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766242432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971753.705261:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766242432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.705269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790971753.706275:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971753.706332:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971753.706390:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971753.706422:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483d46b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971753.706541:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242560 00000100:00100000:1.0:1790971753.706547:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242560 00000100:00100000:1.0:1790971753.706591:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790971753.706600:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766242560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971753.706894:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766242560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971753.706902:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790971753.708648:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790971753.719455:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11679:1877969766242688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971753.719759:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971753.722344:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971753.722663:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242688 00000100:00100000:2.0:1790971753.722672:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242688 00000100:00100000:2.0:1790971753.722739:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790971753.722749:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:11679:x1877969766242688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971753.723030:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+17:11679:x1877969766242688:12345-0@lo:502:llog_process_th.0 Request processed in 282us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971753.723046:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790971753.723348:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11679:1877969766242688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971753.723386:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971753.723396:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971753.723399:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790971753.723406:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cd4bfbb1000 00000020:00000080:3.0:1790971753.723409:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790971753.723537:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11679:1877969766242816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971753.723582:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971753.723612:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971753.724875:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242816 00000100:00100000:2.0:1790971753.724884:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242816 00000100:00100000:2.0:1790971753.724928:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790971753.724936:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:11679:x1877969766242816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971753.728252:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+17:11679:x1877969766242816:12345-0@lo:502:llog_process_th.0 Request processed in 3307us (4660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971753.728266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790971753.732732:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11679:1877969766242816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790971753.732950:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971753.732969:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971753.732971:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790971753.732976:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790971753.733279:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790971753.733312:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790971753.733323:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.733345:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971753.733355:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790971753.733358:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4be529000 from 7 10000000:01000000:3.0:1790971753.733361:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790971753.733394:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.733403:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.733419:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971753.733441:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.733940:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971753.733978:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971753.737413:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766242944 00000100:00100000:1.0:1790971753.737428:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766242944 00000100:00100000:1.0:1790971753.737520:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1790971753.737531:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+17:5836:x1877969766242944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971753.737550:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971753.737571:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f497b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f497ac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971753.737602:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f497b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f497ac expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971753.737613:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f497b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f497ac expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971753.737622:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42c00, rc 0) 00000100:00100000:1.0:1790971753.737750:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766242944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971753.737758:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790971753.737845:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766242944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971753.737866:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971753.737887:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971753.737959:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971753.737993:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971753.738030:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971753.738072:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243072 00000100:00100000:1.0:1790971753.738077:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243072 00000100:00100000:1.0:1790971753.738108:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790971753.738115:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766243072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790971753.738578:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766243072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 461us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971753.738586:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790971753.738681:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971753.738714:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971753.738753:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971753.738784:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971753.738798:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243200 00000100:00100000:0.0:1790971753.738802:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243200 00000100:00100000:0.0:1790971753.738828:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1790971753.738835:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766243200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971753.739028:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766243200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.739038:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790971753.739039:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971753.739951:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11682:1877969766243328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971753.739997:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971753.740068:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a0240 going to sleep for 11 seconds 00000100:00100000:1.0:1790971753.740433:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243328 00000100:00100000:1.0:1790971753.740440:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243328 00000100:00100000:1.0:1790971753.740596:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1790971753.740606:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:11682:x1877969766243328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971753.740838:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:11682:x1877969766243328:12345-0@lo:502:llog_process_th.0 Request processed in 234us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971753.740846:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790971753.740912:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11682:1877969766243328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971753.740938:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971753.740946:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971753.740949:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790971753.740955:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cd4be529000 00000020:00000080:3.0:1790971753.740957:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790971753.741026:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11682:1877969766243456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971753.741060:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971753.741330:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243456 00000100:00100000:0.0:1790971753.741343:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243456 00000100:00100000:0.0:1790971753.741365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790971753.741372:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:11682:x1877969766243456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971753.741533:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+18:11682:x1877969766243456:12345-0@lo:502:llog_process_th.0 Request processed in 160us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.741540:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790971753.745729:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971753.745772:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11682:1877969766243456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790971753.745875:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790971753.745883:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790971753.745885:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790971753.745890:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790971753.747272:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790971753.747310:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790971753.747322:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.747335:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971753.747346:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790971753.747349:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4b52bc800 from 7 10000000:01000000:3.0:1790971753.747351:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790971753.747392:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.747400:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.747409:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971753.747644:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.747707:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971753.747739:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971753.747759:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243584 00000100:00100000:3.0:1790971753.747765:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243584 00000100:00100000:3.0:1790971753.747815:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790971753.747823:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:5836:x1877969766243584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971753.747835:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971753.747847:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f497c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f497ba expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.747869:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f497c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f497ba expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.747878:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f497c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f497ba expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.747886:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c000, rc 0) 00000100:00100000:3.0:1790971753.747922:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766243584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971753.747929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790971753.747980:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971753.747994:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971753.748002:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971753.748050:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.748076:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971753.748089:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971753.748100:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243712 00000100:00100000:3.0:1790971753.748103:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243712 00000100:00100000:3.0:1790971753.748120:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790971753.748135:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766243712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.748530:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766243712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971753.748538:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790971753.748570:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.748609:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.748649:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971753.748666:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971753.748679:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243840 00000100:00100000:3.0:1790971753.748683:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243840 00000100:00100000:3.0:1790971753.748702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1790971753.748708:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766243840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971753.749028:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:5836:x1877969766243840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 319us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971753.749041:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000040:00080000:2.0:1790971753.753774:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790971753.754933:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0404db5-d37b-41bb-8054-1f8859117a4f:5836:1877969766243840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971753.755947:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11684:1877969766243968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971753.756025:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971753.756065:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4955810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971753.756895:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766243968 00000100:00100000:0.0:1790971753.756905:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766243968 00000100:00100000:0.0:1790971753.756954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1790971753.756962:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:11684:x1877969766243968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971753.757602:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:11684:x1877969766243968:12345-0@lo:502:llog_process_th.0 Request processed in 638us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.757611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1790971753.758058:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11684:1877969766243968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790971753.758090:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971753.758099:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971753.758101:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790971753.758107:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cd4b52bc800 00000020:00000080:2.0:1790971753.758109:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790971753.759740:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11684:1877969766244096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971753.760286:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971753.761275:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe90900 going to sleep for 11 seconds 00000100:00100000:0.0:1790971753.765881:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244096 00000100:00100000:0.0:1790971753.765895:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244096 00000100:00100000:0.0:1790971753.765994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790971753.766004:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:11684:x1877969766244096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790971753.766270:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:11684:x1877969766244096:12345-0@lo:502:llog_process_th.0 Request processed in 266us (5983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971753.766278:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1790971753.766375:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be18a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0404db5-d37b-41bb-8054-1f8859117a4f:11684:1877969766244096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790971753.766410:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971753.766418:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971753.766421:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790971753.766446:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790971753.774525:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790971753.774568:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971753.774579:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971753.774607:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971754.596681:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790971754.789155:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790971755.365026:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971755.365050:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766244224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971755.365120:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971755.365235:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244224 00000100:00100000:3.0:1790971755.365244:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244224 00000100:00100000:3.0:1790971755.365317:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790971755.365326:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766244224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971755.365362:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971755.365409:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766244224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971755.365428:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1790971755.365564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790971755.367021:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02ce300 x1877969766244224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971755.367046:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766244224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790971755.623193:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971755.877055:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766244736:0@lo:400:kworker.0 00000100:00100000:1.0:1790971755.877132:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971755.877192:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790971755.877199:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766244608:0@lo:400:kworker.0 00000100:00100000:1.0:1790971755.877225:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971755.878008:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766244352:0@lo:400:kworker.0 00000100:00100000:2.0:1790971755.878052:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971755.878093:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766244864:0@lo:400:kworker.0 00000100:00100000:2.0:1790971755.878121:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971755.878144:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790971755.878150:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766244480:0@lo:400:kworker.0 00000100:00100000:2.0:1790971755.878195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971755.878229:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244864 00000100:00100000:2.0:1790971755.878237:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244864 00000100:00100000:2.0:1790971755.878805:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790971755.878817:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766244864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971755.878877:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766244864:12345-0@lo:400:kworker.0 Request processed in 62us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971755.879003:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244736 00000100:00100000:3.0:1790971755.879009:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244736 00000100:00100000:3.0:1790971755.879037:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244608 00000100:00100000:3.0:1790971755.879052:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244608 00000100:00100000:3.0:1790971755.879067:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244480 00000100:00100000:3.0:1790971755.879070:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244480 00000100:00100000:3.0:1790971755.879094:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790971755.879101:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766244736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971755.879143:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766244736:12345-0@lo:400:kworker.0 Request processed in 43us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971755.879151:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790971755.879175:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790971755.879180:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766244608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971755.879212:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766244608:12345-0@lo:400:kworker.0 Request processed in 31us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971755.879218:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790971755.879234:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790971755.879240:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766244480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971755.879503:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766244480:12345-0@lo:400:kworker.0 Request processed in 262us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971755.879510:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790971755.879959:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766244992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971755.879998:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971755.880040:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244992 00000100:00100000:3.0:1790971755.880046:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244992 00000100:00100000:0.0:1790971755.880181:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766244352 00000100:00100000:0.0:1790971755.880185:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766244352 00000100:00100000:0.0:1790971755.880214:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1790971755.880222:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766244352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971755.880273:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766244352:12345-0@lo:400:kworker.0 Request processed in 52us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971755.880279:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:0.0:1790971755.880345:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971755.880352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971755.880386:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766244480:0@lo:400:kworker.0 00000100:00100000:2.0:1790971755.880663:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790971755.880797:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766244352:0@lo:400:kworker.0 00000100:00100000:0.0:1790971755.880810:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766244864:0@lo:400:kworker.0 00000100:00100000:1.0:1790971755.881213:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790971755.881226:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766244992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971755.881291:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971755.881351:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766244992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971755.881358:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790971755.885070:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766244608:0@lo:400:kworker.0 00000100:00100000:1.0:1790971755.888853:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766244736:0@lo:400:kworker.0 00000100:00100000:2.0:1790971755.888859:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766244992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971755.942987:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971755.943091:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971755.946695:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971755.946733:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971755.946773:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239808 00000100:00100000:3.0:1790971755.946782:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239808 00000100:00100000:3.0:1790971755.946850:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1790971755.946860:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745239808:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971755.946928:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745239808:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 68us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971755.946935:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00080000:3.0:1790971755.946975:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971755.948033:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239552 00000100:00100000:2.0:1790971755.948044:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239552 00000100:00100000:2.0:1790971755.948099:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 280 00000100:00100000:2.0:1790971755.948108:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745239552:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971755.948185:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745239552:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 78us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971755.948192:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 280 00000100:00100000:0.0:1790971755.954747:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239680 00000100:00100000:0.0:1790971755.954763:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239680 00000100:00100000:0.0:1790971755.954859:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745239936 00000100:00100000:0.0:1790971755.954863:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745239936 00000100:00100000:0.0:1790971755.954890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:0.0:1790971755.954900:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745239680:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971755.954991:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745239680:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 91us (12012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971755.954999:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:0.0:1790971755.955022:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1790971755.955029:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745239936:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971755.955056:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745239936:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (11965us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971755.955062:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00080000:3.0:1790971755.956980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1790971756.434300:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1790971756.651204:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971757.669382:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971758.696014:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971759.716956:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971760.484750:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790971760.484775:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766245120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971760.484846:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971760.484967:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766245120 00000100:00100000:2.0:1790971760.484976:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766245120 00000100:00100000:2.0:1790971760.485043:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790971760.485053:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766245120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971760.485089:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971760.485135:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766245120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971760.485142:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1790971760.485219:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cdc00 x1877969766245120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971760.485238:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766245120:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971760.485306:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790971760.741076:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971760.996940:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766245376:0@lo:400:kworker.0 00000100:00100000:0.0:1790971760.997163:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971760.997260:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971760.997270:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766245504:0@lo:400:kworker.0 00000100:00100000:0.0:1790971760.997306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971760.997362:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766245376 00000100:00100000:0.0:1790971760.997373:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766245376 00000100:00100000:0.0:1790971760.997433:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766245504 00000100:00100000:0.0:1790971760.997436:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766245504 00000100:00080000:3.0:1790971760.997632:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971760.997661:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766245632:0@lo:400:kworker.0 00000100:00100000:3.0:1790971760.997698:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971760.997821:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766245248:0@lo:400:kworker.0 00000100:00100000:2.0:1790971760.997865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971761.002610:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790971761.002633:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766245888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971761.002749:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766245632 00000100:00100000:0.0:1790971761.002762:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766245632 00000100:00100000:0.0:1790971761.002846:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790971761.002860:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766245376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971761.002965:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766245376:12345-0@lo:400:kworker.0 Request processed in 109us (5803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971761.002975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790971761.003140:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766245760:0@lo:400:kworker.0 00000100:00100000:2.0:1790971761.003186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971761.003863:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766245760 00000100:00100000:2.0:1790971761.003870:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766245760 00000100:00100000:2.0:1790971761.003915:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790971761.003925:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766245760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971761.003981:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766245760:12345-0@lo:400:kworker.0 Request processed in 58us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971761.004001:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790971761.004044:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1790971761.004050:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4c02cdf80, transno 4294967300 00000100:00100000:2.0:1790971761.004077:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766245760:0@lo:400:kworker.0 00000100:00100000:2.0:1790971761.004596:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766245376:0@lo:400:kworker.0 00000100:00080000:2.0:1790971761.004629:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790971761.004635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971761.004759:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971761.004812:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766245888 00000100:00100000:3.0:1790971761.004817:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766245888 00000100:00100000:3.0:1790971761.004858:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790971761.004867:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766245888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971761.004898:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971761.004943:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766245888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971761.004950:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790971761.004987:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766245888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971761.006053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790971761.006079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790971761.006102:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766245632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971761.006196:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766245632:12345-0@lo:400:kworker.0 Request processed in 105us (8496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971761.006287:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790971761.006316:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766245504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971761.006467:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766245504:12345-0@lo:400:kworker.0 Request processed in 399us (9158us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971761.006506:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790971761.006513:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766245632:0@lo:400:kworker.0 00000100:00100000:0.0:1790971761.006579:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766245248 00000100:00100000:0.0:1790971761.006586:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766245248 00000100:00100000:0.0:1790971761.006637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1790971761.006644:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766245248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971761.006802:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766245248:12345-0@lo:400:kworker.0 Request processed in 159us (8937us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971761.006810:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1790971761.006876:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766245504:0@lo:400:kworker.0 00000100:00100000:0.0:1790971761.006911:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766245248:0@lo:400:kworker.0 00000100:00100000:3.0:1790971761.062092:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971761.062219:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971761.062266:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971761.062311:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971761.062353:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240192 00000100:00100000:3.0:1790971761.062368:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240192 00000100:00100000:3.0:1790971761.062440:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240448 00000100:00100000:3.0:1790971761.062443:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240448 00000100:00100000:3.0:1790971761.062522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1790971761.062535:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745240192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971761.062639:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745240192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971761.063107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1790971761.063142:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:3.0:1790971761.063152:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745240448:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971761.063193:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745240448:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971761.063223:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:1.0:1790971761.063396:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240320 00000100:00100000:1.0:1790971761.063412:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240320 00000100:00100000:1.0:1790971761.063555:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1790971761.063567:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745240320:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971761.063663:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745240320:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 98us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971761.063697:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00080000:2.0:1790971761.066196:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790971761.066212:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971761.069119:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240064 00000100:00100000:0.0:1790971761.069144:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240064 00000100:00100000:0.0:1790971761.069267:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 282 00000100:00100000:0.0:1790971761.069279:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745240064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971761.069409:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745240064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 132us (7331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971761.069419:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 282 00010000:00010000:0.0:1790971761.767332:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971762.790703:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971763.813276:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790971764.005292:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790971764.836741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971765.605280:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766246016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971765.605378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971765.605573:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246016 00000100:00100000:3.0:1790971765.605582:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246016 00000100:00100000:3.0:1790971765.605655:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790971765.605664:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766246016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971765.605698:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971765.605748:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766246016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971765.605755:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1790971765.605798:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cfb80 x1877969766246016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971765.605828:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766246016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790971765.606112:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790971765.860775:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971766.118149:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766246400:0@lo:400:kworker.0 00000100:00100000:3.0:1790971766.118225:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971766.118283:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971766.118289:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766246528:0@lo:400:kworker.0 00000100:00100000:3.0:1790971766.118328:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971766.118540:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766246144:0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.118578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971766.118608:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246144 00000100:00100000:1.0:1790971766.118615:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246144 00000100:00100000:1.0:1790971766.118654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1790971766.118662:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766246144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.118711:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766246144:12345-0@lo:400:kworker.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.118719:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1790971766.118781:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246400 00000100:00100000:1.0:1790971766.118785:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246400 00000100:00100000:1.0:1790971766.118820:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790971766.118826:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766246400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.118867:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766246400:12345-0@lo:400:kworker.0 Request processed in 41us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.118874:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790971766.118905:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246528 00000100:00100000:1.0:1790971766.118910:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246528 00000100:00100000:1.0:1790971766.118937:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790971766.118943:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766246528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.118977:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766246528:12345-0@lo:400:kworker.0 Request processed in 34us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.118983:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790971766.120031:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766246144:0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.120044:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766246656:0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.120084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971766.120124:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790971766.120132:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766246272:0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.120280:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971766.120504:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766246784:0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.120536:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971766.120568:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246656 00000100:00100000:1.0:1790971766.120573:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246656 00000100:00100000:1.0:1790971766.120608:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246272 00000100:00100000:1.0:1790971766.120611:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246272 00000100:00100000:1.0:1790971766.120629:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790971766.120636:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766246656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790971766.121002:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971766.121021:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790971766.121031:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766246912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971766.121062:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971766.121112:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246784 00000100:00100000:0.0:1790971766.121116:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246784 00010000:00080000:3.0:1790971766.121535:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cf800 x1877969766246528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971766.121549:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766246528:0@lo:400:kworker.0 00000100:00100000:3.0:1790971766.121565:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766246400:0@lo:400:kworker.0 00000100:00100000:3.0:1790971766.121592:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766246912 00000100:00100000:3.0:1790971766.121596:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766246912 00000100:00100000:3.0:1790971766.121626:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790971766.121650:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766246912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971766.121680:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971766.122115:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790971766.122125:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766246784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971766.122315:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd386c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766246912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971766.122615:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766246656:12345-0@lo:400:kworker.0 Request processed in 1977us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.122625:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790971766.122646:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790971766.122654:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766246272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.122698:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766246272:12345-0@lo:400:kworker.0 Request processed in 45us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.122704:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1790971766.122835:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766246912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971766.122842:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790971766.122899:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766246272:0@lo:400:kworker.0 00000100:00100000:1.0:1790971766.122911:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766246656:0@lo:400:kworker.0 00000100:00080000:0.0:1790971766.128649:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971766.128751:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766246784:12345-0@lo:400:kworker.0 Request processed in 6622us (8206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971766.128764:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790971766.135197:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766246784:0@lo:400:kworker.0 00000100:00100000:3.0:1790971766.184691:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971766.184740:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971766.184844:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240704 00000100:00100000:2.0:1790971766.184855:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240704 00000100:00100000:2.0:1790971766.184934:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:2.0:1790971766.184945:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2354:x1877969745240704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971766.185022:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2354:x1877969745240704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971766.185030:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00080000:0.0:1790971766.185099:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971766.185162:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240576 00000100:00100000:1.0:1790971766.185167:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240576 00000100:00100000:1.0:1790971766.185219:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 284 00000100:00100000:1.0:1790971766.185228:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745240576:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971766.185259:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745240576:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.185266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 284 00000100:00100000:3.0:1790971766.198722:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971766.201076:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240832 00000100:00100000:1.0:1790971766.201090:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240832 00000100:00100000:1.0:1790971766.201191:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1790971766.201201:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2353:x1877969745240832:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:1.0:1790971766.201240:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f496fd 00000100:00080000:1.0:1790971766.201248:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cd386fa8800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1790971766.201446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1790971766.201574:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1790971766.201846:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+2:2353:x1877969745240832:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 645us (3134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.201855:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00010000:00010000:3.0:1790971766.203576:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971766.208180:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971766.208381:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745240960 00000100:00100000:1.0:1790971766.208391:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745240960 00000100:00100000:1.0:1790971766.208467:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:1.0:1790971766.208503:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745240960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971766.208577:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2355:x1877969745240960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 76us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971766.208585:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00080000:0.0:1790971766.208904:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1790971766.664827:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:3.0:1790971766.664836:0:7646:0:(genops.c:885:class_export_put()) final put ffff8cd386fa9800/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:2.0:1790971766.664903:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd386fa9800/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 for lustre-OST0001 00000020:00000080:2.0:1790971766.669731:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd386fa8800 for lustre-OST0001 00010000:00010000:0.0:1790971766.884678:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971767.908660:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971768.932621:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971769.956679:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971770.724745:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766247040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971770.724816:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971770.725414:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247040 00000100:00100000:1.0:1790971770.725437:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247040 00000100:00100000:1.0:1790971770.725524:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790971770.725534:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766247040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790971770.725571:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971770.725637:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766247040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971770.725645:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1790971770.725807:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cdf80 x1877969766247040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971770.725837:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766247040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790971770.726744:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790971770.980724:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971771.236648:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766247168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971771.236718:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971771.236899:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247168 00000100:00100000:0.0:1790971771.236907:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247168 00000100:00100000:0.0:1790971771.236973:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790971771.236982:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766247168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790971771.237016:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971771.237062:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766247168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971771.237069:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1790971771.237161:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971771.240626:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766247168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971771.240655:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971771.240665:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766247296:0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.240736:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971771.240814:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247296 00000100:00100000:2.0:1790971771.240822:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247296 00000100:00100000:2.0:1790971771.240863:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790971771.240872:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766247296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.240921:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766247296:12345-0@lo:400:kworker.0 Request processed in 50us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971771.240928:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790971771.241123:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766247296:0@lo:400:kworker.0 00000100:00100000:1.0:1790971771.244319:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971771.244341:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766247424:0@lo:400:kworker.0 00000100:00100000:0.0:1790971771.244598:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971771.244607:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766247552:0@lo:400:kworker.0 00000100:00100000:0.0:1790971771.244653:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766247680:0@lo:400:kworker.0 00000100:00100000:0.0:1790971771.244680:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971771.244724:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247680 00000100:00100000:0.0:1790971771.244731:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247680 00000100:00100000:0.0:1790971771.244774:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790971771.244783:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766247680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971771.244837:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766247680:12345-0@lo:400:kworker.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971771.244843:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1790971771.244884:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4883f0000 x1877969766247680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971771.244896:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766247680:0@lo:400:kworker.0 00000100:00100000:0.0:1790971771.244928:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971771.244933:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766247808:0@lo:400:kworker.0 00000100:00100000:1.0:1790971771.245129:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971771.245277:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247424 00000100:00100000:2.0:1790971771.245282:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247424 00000100:00100000:2.0:1790971771.245315:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790971771.245322:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766247424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.245362:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766247424:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971771.245369:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790971771.245491:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971771.245591:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766247424:0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.249565:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247552 00000100:00100000:2.0:1790971771.249582:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247552 00000100:00100000:2.0:1790971771.249707:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790971771.249719:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766247552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.249806:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766247552:12345-0@lo:400:kworker.0 Request processed in 92us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971771.249813:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1790971771.249911:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971771.249919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971771.249955:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766247552:0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.250019:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247808 00000100:00100000:2.0:1790971771.250024:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247808 00000100:00100000:2.0:1790971771.250056:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790971771.250062:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766247808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.250119:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766247808:12345-0@lo:400:kworker.0 Request processed in 55us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971771.250125:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1790971771.250230:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971771.251331:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766247808:0@lo:400:kworker.0 00000100:00100000:2.0:1790971771.302540:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971771.302572:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971771.302609:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971771.302662:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241216 00000100:00100000:0.0:1790971771.302705:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241088 00000100:00100000:0.0:1790971771.302726:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241088 00000100:00100000:1.0:1790971771.302729:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241216 00000100:00100000:0.0:1790971771.302784:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 286 00000100:00100000:3.0:1790971771.302829:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241344 00000100:00100000:3.0:1790971771.302833:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241344 00000100:00100000:0.0:1790971771.302856:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745241088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971771.302930:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745241088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 137us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971771.302955:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 286 00000100:00100000:1.0:1790971771.303303:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:1.0:1790971771.303312:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745241216:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971771.303360:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745241216:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 49us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971771.303366:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00080000:2.0:1790971771.307495:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971771.310322:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:0.0:1790971771.310339:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745241344:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971771.310432:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745241344:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 98us (7821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971771.310440:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00010000:00010000:2.0:1790971772.005333:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971773.028696:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971774.059670:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790971774.246579:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790971775.080861:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790971775.770837:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:09:34 (1790971774) 00000100:00100000:1.0:1790971775.850164:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766247936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971775.850235:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971775.852793:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766247936 00000100:00100000:0.0:1790971775.852807:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766247936 00000100:00100000:0.0:1790971775.852876:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790971775.852885:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766247936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971775.852931:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790971775.853019:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790971775.853374:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766247936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 489us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971775.853382:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1790971775.854796:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cd500 x1877969766247936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971775.854822:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766247936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790971776.100733:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971776.357209:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766248064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971776.357281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971776.357372:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766248064 00000100:00100000:2.0:1790971776.357392:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766248064 00000100:00100000:3.0:1790971776.357620:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766248320:0@lo:400:kworker.0 00000100:00100000:3.0:1790971776.357678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971776.357679:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790971776.357693:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766248064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971776.357705:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790971776.357712:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766248192:0@lo:400:kworker.0 00002000:00000024:2.0:1790971776.357730:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971776.357745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971776.357768:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766248704:0@lo:400:kworker.0 00000100:00100000:2.0:1790971776.357787:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766248064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971776.357798:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971776.357800:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790971776.357829:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766248192 00000100:00100000:3.0:1790971776.357833:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766248192 00000100:00100000:3.0:1790971776.357868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1790971776.357875:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766248192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971776.357921:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766248192:12345-0@lo:400:kworker.0 Request processed in 46us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971776.357927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1790971776.357978:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766248192:0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358054:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766248320 00000100:00100000:1.0:1790971776.358059:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766248320 00000100:00100000:1.0:1790971776.358096:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766248704 00000100:00100000:1.0:1790971776.358099:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766248704 00000100:00100000:1.0:1790971776.358119:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790971776.358125:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766248320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358174:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766248320:12345-0@lo:400:kworker.0 Request processed in 48us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971776.358180:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790971776.358191:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790971776.358197:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766248704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358223:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766248704:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971776.358228:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790971776.358248:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766248448:0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358274:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971776.358291:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790971776.358296:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766248576:0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971776.358359:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766248576 00000100:00100000:1.0:1790971776.358363:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766248576 00000100:00100000:1.0:1790971776.358396:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790971776.358402:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766248576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358437:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766248576:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971776.358443:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1790971776.358496:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd4c02cd500 x1877969766248576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790971792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971776.358507:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766248576:0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358523:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766248448 00000100:00100000:1.0:1790971776.358526:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766248448 00000100:00100000:1.0:1790971776.358547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790971776.358553:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766248448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971776.358585:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766248448:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971776.358591:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790971776.358617:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766248448:0@lo:400:kworker.0 00000100:00080000:0.0:1790971776.359295:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971776.359302:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971776.359602:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766248064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971776.359749:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766248704:0@lo:400:kworker.0 00000100:00100000:3.0:1790971776.359761:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766248320:0@lo:400:kworker.0 00000100:00100000:0.0:1790971776.421626:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971776.421685:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971776.421734:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971776.421859:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241728 00000100:00100000:3.0:1790971776.421872:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241728 00000100:00100000:3.0:1790971776.421951:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241600 00000100:00100000:3.0:1790971776.421955:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241600 00000100:00100000:3.0:1790971776.421981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:3.0:1790971776.421992:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745241728:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971776.422107:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745241728:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 116us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971776.422116:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:3.0:1790971776.422152:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:3.0:1790971776.422159:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745241600:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971776.422188:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745241600:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971776.422195:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00080000:0.0:1790971776.422408:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971776.422513:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241472 00000100:00100000:2.0:1790971776.422518:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241472 00000100:00100000:2.0:1790971776.422558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 288 00000100:00100000:2.0:1790971776.422566:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745241472:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971776.422600:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745241472:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 34us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971776.422606:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 288 00010000:00010000:0.0:1790971777.124742:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971777.423817:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971777.423923:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241856 00000100:00100000:1.0:1790971777.423932:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241856 00000100:00100000:1.0:1790971777.423990:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:1.0:1790971777.424000:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:10237:x1877969745241856:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971777.424021:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971777.424114:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f497c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a311 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971777.424187:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f497cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971777.424218:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f497cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971777.424231:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f497cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971777.424266:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790971777.425104:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971777.425161:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f497cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971777.425189:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f497c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a311 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971777.425206:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f497cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a311 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971777.425216:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971777.425219:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971777.425222:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43200, rc 0) 00000100:00100000:1.0:1790971777.425434:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:10237:x1877969745241856:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1434us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971777.425441:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:1.0:1790971777.456433:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971777.456615:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745241984 00000100:00100000:0.0:1790971777.456624:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745241984 00000100:00100000:0.0:1790971777.456678:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1790971777.456687:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:10238:x1877969745241984:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971777.456707:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971777.456725:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f497d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.456786:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.456800:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.456811:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.456837:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.456844:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.456852:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457060:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbda00/0xbd3388eaa6f497eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457069:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbda00/0xbd3388eaa6f497eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457215:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbda00/0xbd3388eaa6f497eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971777.457242:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790971777.457245:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971777.457435:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbda00/0xbd3388eaa6f497eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457447:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457454:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457460:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457466:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbcc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971777.457515:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457525:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457537:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971777.457540:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971777.457545:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457551:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f497dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457575:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457581:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457588:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457592:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbde00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971777.457595:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457601:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457608:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cd487fd8f00) 00010000:00010000:0.0:1790971777.457610:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971777.457612:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457617:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f497e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457647:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f497d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a318 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457659:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbda00/0xbd3388eaa6f497eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a318 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971777.457676:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cd487fd8200) 00010000:00010000:0.0:1790971777.457679:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971777.457681:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbda00, rc 0) 00000100:00100000:0.0:1790971777.457746:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:10238:x1877969745241984:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1059us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971777.457753:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1790971777.466557:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971777.466654:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745242240 00000100:00100000:3.0:1790971777.466663:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745242240 00000100:00100000:3.0:1790971777.466714:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1790971777.466734:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:10238:x1877969745242240:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971777.466753:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971777.466770:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f497f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a31f expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.466838:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.466852:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.466862:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.466927:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.466935:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.466943:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467564:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49807 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467574:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49807 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467582:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49807 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971777.467600:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790971777.467739:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467746:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467752:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467756:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971777.467760:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467767:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467777:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cd487fd8200) 00010000:00010000:3.0:1790971777.467780:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971777.467784:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467790:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f497f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467802:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467807:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467822:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467827:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971777.467830:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467836:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467844:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cd483040200) 00010000:00010000:3.0:1790971777.467847:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971777.467850:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.467855:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49800 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.472743:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f497f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a31f expref: 10 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.472771:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49807 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a31f expref: 9 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971777.472780:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:3.0:1790971777.472783:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971777.472787:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d000, rc 0) 00000100:00100000:3.0:1790971777.472869:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10238:x1877969745242240:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6135us (6321us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790971777.472888:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1790971777.483256:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971777.483383:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745242368 00000100:00100000:0.0:1790971777.483394:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745242368 00000100:00100000:0.0:1790971777.483453:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:0.0:1790971777.483463:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10238:x1877969745242368:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790971777.483597:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10238:x1877969745242368:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971777.483604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00010000:00010000:2.0:1790971778.149941:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790971778.345941:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790971779.178632:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971779.471443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971779.471510:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745242496 00000100:00100000:3.0:1790971779.471522:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745242496 00000100:00100000:3.0:1790971779.471594:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:3.0:1790971779.471606:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10281:x1877969745242496:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971779.471634:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971779.471661:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a326 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.471747:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.471764:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.471777:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.471794:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.471802:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.471809:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472072:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472081:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472088:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472094:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971779.472099:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472107:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472131:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971779.472135:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971779.472141:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472147:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4981c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472158:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472164:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472170:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472185:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971779.472188:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472194:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472202:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cd483040a00) 00010000:00010000:3.0:1790971779.472204:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971779.472206:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472211:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49823 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472247:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49815 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a326 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472259:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971779.472262:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971779.472266:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a326 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.472276:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d600, rc 0) 00000100:00100000:3.0:1790971779.472353:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10281:x1877969745242496:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 750us (924us total) trans 0 rc 301/301 00000100:00100000:3.0:1790971779.472364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00080000:0.0:1790971779.473395:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971779.484278:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.484467:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745242752 00000100:00100000:1.0:1790971779.484515:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745242752 00000100:00100000:1.0:1790971779.484587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:1.0:1790971779.484598:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10281:x1877969745242752:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:1.0:1790971779.484682:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971779.484717:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f497cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a311 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.484743:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971779.484757:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971779.485030:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.485047:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.485058:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.485071:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.485079:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.485085:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971779.486086:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790971779.486103:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.486126:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.486133:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.486147:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971779.486153:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.486161:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.486175:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971779.486178:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971779.486182:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.486189:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4982a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790971779.486211:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008564cae3 reply state 00000000cecbafbe transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971779.486221:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790971779.486370:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:10281:x1877969745242752:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 1770us (2117us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790971779.486381:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00010000:00010000:3.0:1790971779.489643:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.489666:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.489675:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.489682:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971779.489689:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.489697:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.489717:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cd48dd1b600) 00010000:00010000:3.0:1790971779.489721:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971779.489726:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.489733:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49831 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971779.604613:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971779.604659:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745242880 00000100:00100000:3.0:1790971779.604671:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745242880 00000100:00100000:3.0:1790971779.604734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:3.0:1790971779.604744:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10289:x1877969745242880:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:3.0:1790971779.604776:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971779.604805:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a32d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.604895:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4983f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.604913:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4983f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.604927:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4983f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971779.604971:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790971779.604977:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971779.605024:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4983f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.605053:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a32d expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.605072:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4983f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a32d expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.605082:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971779.605085:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971779.605089:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c200, rc 0) 00000100:00100000:3.0:1790971779.605188:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:10289:x1877969745242880:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 444us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971779.605197:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:3.0:1790971779.651611:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.651752:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745243008 00000100:00100000:1.0:1790971779.651767:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745243008 00000100:00100000:1.0:1790971779.651847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1790971779.651858:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:10295:x1877969745243008:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1790971779.651886:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971779.651924:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a334 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652214:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652235:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652250:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652270:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652277:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652284:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652410:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f4985b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652418:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f4985b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652425:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f4985b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971779.652458:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790971779.652461:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971779.652546:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f4985b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652573:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652581:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652590:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652597:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971779.652603:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652612:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652627:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971779.652630:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971779.652637:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652643:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4984d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652660:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652666:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652672:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652683:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971779.652686:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652693:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652706:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971779.652709:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971779.652712:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652718:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49854 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652755:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a334 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652771:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f4985b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a334 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.652779:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971779.652781:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790971779.652784:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42a00, rc 0) 00000100:00100000:1.0:1790971779.652883:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10295:x1877969745243008:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1027us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971779.652892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1790971779.657251:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971779.657465:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745243264 00000100:00100000:0.0:1790971779.657515:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745243264 00000100:00100000:0.0:1790971779.657586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1790971779.657598:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10295:x1877969745243264:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971779.657626:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971779.657654:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49862 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a33b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.657815:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.657840:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.657854:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.658078:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.658103:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.658600:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790971779.662401:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1790971779.662665:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662684:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662695:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662734:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662742:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662749:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662770:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbcc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971779.662775:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662782:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662795:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971779.662798:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971779.662803:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662810:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49869 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971779.662824:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d823d865 reply state 000000002f89cafa transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971779.662833:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790971779.662871:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49862 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662887:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.662894:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8300) 00010000:00010000:0.0:1790971779.662896:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971779.662898:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc400, rc 0) 00000100:00100000:0.0:1790971779.662969:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10295:x1877969745243264:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5373us (5734us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790971779.662986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:2.0:1790971779.668071:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971779.668341:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745243392 00000100:00100000:3.0:1790971779.668355:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745243392 00000100:00100000:3.0:1790971779.668413:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1790971779.668422:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1877969745243392:12345-192.168.203.43@tcp:8:bash.0 00010000:00080000:3.0:1790971779.668463:0:8047:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1790971779.668537:0:8047:0:(genops.c:1384:class_connect()) connect: client aa9b9adf-df76-49fe-88a5-1de8c4d3a597, cookie 0xbd3388eaa6f49885 00002000:00100000:3.0:1790971779.668554:0:8047:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa9b9adf-df76-49fe-88a5-1de8c4d3a597/ffff8cd4b70dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790971779.668585:0:8047:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790971779.668886:0:8047:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790971779.668933:0:8047:0:(import.c:65:import_set_state_nolock()) ffff8cd4b70db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790971779.669021:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2353:x1877969745243392:12345-192.168.203.43@tcp:8:bash.0 Request processed in 598us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971779.669030:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:1.0:1790971779.670252:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.670289:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.670298:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.670306:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971779.670312:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.670321:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.670341:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd487fd8f00) 00010000:00010000:1.0:1790971779.670345:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971779.670350:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.670356:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49870 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971779.674407:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.677168:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745243520 00000100:00100000:1.0:1790971779.677192:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745243520 00000100:00100000:1.0:1790971779.677356:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1790971779.677369:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:0:x1877969745243520:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1790971779.677394:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971779.677426:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a342 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790971779.677513:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971779.677540:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1790971779.677546:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971779.677558:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.677584:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.677600:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43c00, rc 0) 00000100:00100000:1.0:1790971779.677680:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:0:x1877969745243520:12345-192.168.203.43@tcp:101:bash.0 Request processed in 314us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971779.677689:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00080000:0.0:1790971779.680257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790971779.684360:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971779.684529:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745243648 00000100:00100000:3.0:1790971779.684544:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745243648 00000100:00100000:3.0:1790971779.684670:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1790971779.684681:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:10295:x1877969745243648:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971779.684706:0:8047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971779.684732:0:8047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a349 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.684773:0:8047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.684784:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971779.684808:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971779.684815:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 8 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.684858:0:8047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.684873:0:8047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 8 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971779.684889:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8047:1877969766248832:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971779.685013:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30540 going to sleep for 11 seconds 00000100:00100000:3.0:1790971779.688209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971779.689394:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745243776 00000100:00100000:2.0:1790971779.689411:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745243776 00010000:00010000:2.0:1790971779.689515:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 9 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971779.689573:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1790971779.689584:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745243776:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971779.689604:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971779.689635:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 9 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.689652:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 9 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.689686:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971779.689691:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971779.689702:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.689714:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.689763:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971779.689780:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766248960:192.168.203.43@tcp:105: 00000100:00100000:2.0:1790971779.690869:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6600 going to sleep for 11 seconds 00010000:00010000:0.0:1790971779.692097:0:8047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ffcd70/0xbd3388eaa6f4988c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a342 expref: 9 pid: 6691 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971779.692149:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8047:1877969766248832:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971779.692193:0:8047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 8 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.692211:0:8047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ca00, rc 0) 00000100:00100000:0.0:1790971779.692437:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:10295:x1877969745243648:12345-192.168.203.43@tcp:101:bash.0 Request processed in 7756us (8091us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971779.692447:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1790971779.697087:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971779.697104:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766248960:192.168.203.43@tcp:105: 00000100:00100000:1.0:1790971779.697162:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745244032 00000100:00100000:1.0:1790971779.697172:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745244032 00000100:00100000:1.0:1790971779.697253:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1790971779.697273:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10295:x1877969745244032:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1790971779.697756:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10295:x1877969745244032:12345-192.168.203.43@tcp:35:bash.0 Request processed in 490us (685us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790971779.697766:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00010000:00010000:2.0:1790971779.698357:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971779.698442:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745243776:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 8857us (10245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971779.698452:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1790971779.783682:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.783881:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745244288 00000100:00100000:1.0:1790971779.783896:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745244288 00000100:00100000:1.0:1790971779.783977:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1790971779.783988:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10305:x1877969745244288:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971779.784058:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971779.784094:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4989a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a350 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971779.784226:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790971779.784396:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4989a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a350 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.784414:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971779.784417:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790971779.784422:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4989a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a350 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.784442:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43200, rc 0) 00000100:00100000:1.0:1790971779.784597:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10305:x1877969745244288:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 609us (930us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1790971779.784606:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:2.0:1790971779.789575:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.789984:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745244544 00000100:00100000:1.0:1790971779.789997:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745244544 00000100:00100000:1.0:1790971779.790080:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1790971779.790092:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10305:x1877969745244544:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971779.790426:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:10305:x1877969745244544:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 334us (863us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790971779.790435:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1790971779.874705:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971779.874877:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745244672 00000100:00100000:0.0:1790971779.874902:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745244672 00000100:00100000:0.0:1790971779.874982:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1790971779.874994:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:10311:x1877969745244672:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971779.875028:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971779.875055:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f498a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a357 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.875324:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f498af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.875341:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f498af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.875367:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f498af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971779.875503:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790971779.875509:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971779.875539:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f498af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.875572:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f498a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a357 expref: 18 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.875595:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f498af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a357 expref: 17 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.875606:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971779.875609:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971779.875613:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbcc00, rc 0) 00000100:00100000:0.0:1790971779.875706:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10311:x1877969745244672:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 714us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971779.875715:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1790971779.885869:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.886056:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745244928 00000100:00100000:1.0:1790971779.886069:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745244928 00000100:00100000:1.0:1790971779.886215:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1790971779.886247:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10311:x1877969745244928:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971779.886277:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971779.886396:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a35e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.886710:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f498bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.886729:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f498bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.886743:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f498bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971779.886760:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790971779.886936:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a35e expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.887207:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f498bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a35e expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.887217:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8300) 00010000:00010000:1.0:1790971779.887220:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790971779.887224:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43c00, rc 0) 00000100:00100000:1.0:1790971779.887411:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:10311:x1877969745244928:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1165us (1555us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1790971779.887421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1790971779.898853:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.898908:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971779.899047:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745245312 00000100:00100000:2.0:1790971779.899061:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745245312 00000100:00100000:2.0:1790971779.899175:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1790971779.899187:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:2354:x1877969745245312:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971779.899206:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971779.899238:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f498bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a35e expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.899262:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8300) 00010000:00010000:2.0:1790971779.899266:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971779.899340:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:2354:x1877969745245312:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 155us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971779.899348:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1790971779.899834:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745245184 00000100:00100000:0.0:1790971779.899841:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745245184 00000100:00100000:0.0:1790971779.899888:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1790971779.899897:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:10311:x1877969745245184:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971779.899923:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971779.899943:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f498cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a365 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.900116:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f498d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.900135:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f498d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.900148:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f498d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971779.900163:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790971779.900325:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f498cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a365 expref: 21 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.900341:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f498d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a365 expref: 20 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971779.900350:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8300) 00010000:00010000:0.0:1790971779.900353:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790971779.900355:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbde00, rc 0) 00000100:00100000:0.0:1790971779.900409:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:10311:x1877969745245184:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 513us (1571us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790971779.900417:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1790971779.912818:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971779.912908:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745245440 00000100:00100000:2.0:1790971779.912921:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745245440 00000100:00100000:2.0:1790971779.913002:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1790971779.913013:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745245440:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:2.0:1790971779.913077:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.913133:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 7 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.913143:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971779.913148:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971779.913153:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.913199:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 7 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.913216:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 7 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971779.913235:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1877969766249088:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971779.913358:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1790971779.923754:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1877969766249088:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971779.923797:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971779.924044:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.925512:0:6694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745245568 00000100:00100000:1.0:1790971779.925526:0:6694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745245568 00002000:00100000:1.0:1790971779.925576:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8cd4bddf6d80 x1877969745245568/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:50/0 lens 504/0 e 0 to 0 dl 1790971790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790971779.925597:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bddf6d80 with x1877969745245568 ext(0->12) 00010000:00010000:1.0:1790971779.925606:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 8 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.925624:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 8 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790971779.925632:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4bddf6d80 00000100:00100000:1.0:1790971779.925666:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1790971779.925675:0:6694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745245568:12345-192.168.203.43@tcp:4:lfs.0 00000001:00100000:2.0:1790971779.974249:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000100:00100000:1.0:1790971779.976742:0:6694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745245568:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 51052us (52691us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790971779.976760:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:1.0:1790971779.976778:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8cd4bddf6d80 x1877969745245568/t4294967299(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:50/0 lens 504/448 e 0 to 0 dl 1790971790 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790971779.976790:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bddf6d80 with x1877969745245568 ext(0->12) 00010000:00010000:1.0:1790971779.976805:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.976832:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790971779.976856:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4bddf6d80 00000100:00100000:3.0:1790971779.981411:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.981715:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745245696 00000100:00100000:1.0:1790971779.981728:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745245696 00010000:00010000:1.0:1790971779.981784:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971779.981893:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1790971779.981916:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2356:x1877969745245696:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971779.981937:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790971779.981963:0:7634:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790971779.981966:0:7634:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790971779 00002000:00010000:1.0:1790971779.981969:0:7634:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790971780 00002000:00010000:1.0:1790971779.981971:0:7634:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790971779 00010000:00010000:1.0:1790971779.981979:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.981995:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.982026:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49893 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a349 expref: 9 pid: 8047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.982048:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790971779.982054:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790971779.982073:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.982114:0:7634:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.982159:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971779.982616:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745245696:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 700us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971779.982625:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00010000:00010000:3.0:1790971779.983129:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983144:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983184:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983210:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983219:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983240:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971779.983244:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983255:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983275:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971779.983283:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f498e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971779.983383:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745245440:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 70371us (70579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971779.983392:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1790971779.986397:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971779.986863:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745245952 00000100:00100000:1.0:1790971779.986879:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745245952 00000100:00100000:1.0:1790971779.986983:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1790971779.986995:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:10311:x1877969745245952:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:1.0:1790971779.987095:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f498d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a365 expref: 20 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790971779.987523:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1790971779.987585:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1790971779.988259:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1790971779.988330:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.988351:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.988360:0:5841:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.988414:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.988443:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 24 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971779.988464:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddcd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1877969766249216:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971779.988620:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1790971779.992176:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971779.992511:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745246080 00000100:00100000:2.0:1790971779.992524:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745246080 00000100:00100000:1.0:1790971779.992543:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddcd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1877969766249216:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971779.992582:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.992583:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 25 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971779.992662:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1790971779.992675:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:2356:x1877969745246080:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971779.992697:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971779.992705:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 25 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.992718:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 25 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.992746:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a33b expref: 25 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.992764:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8300) 00010000:00010000:2.0:1790971779.992770:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.992780:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.992788:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971779.993125:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971779.993264:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:2356:x1877969745246080:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 589us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971779.993276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00010000:00010000:1.0:1790971779.993285:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971779.993296:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790971779.993503:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1790971779.993747:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1790971779.993872:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddcd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766249344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790971779.994003:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971779.994047:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1790971779.994091:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766249344 00000100:00100000:2.0:1790971779.994119:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766249344 00000100:00100000:2.0:1790971779.994191:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790971779.994200:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766249344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790971779.994286:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766249344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971779.994291:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790971779.994675:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971779.998507:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddcd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766249344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790971779.999814:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1790971779.999943:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddcd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766249472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790971780.000038:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971780.000085:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1790971780.000251:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766249472 00000100:00100000:3.0:1790971780.000260:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766249472 00000100:00100000:3.0:1790971780.000394:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971780.000406:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766249472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790971780.000675:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1877969766249472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 270us (637us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790971780.000683:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971780.000789:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddcd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766249472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790971780.000865:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1790971780.002010:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.002028:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.002038:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.002045:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971780.002051:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.002061:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.002082:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8300) 00010000:00010000:1.0:1790971780.002085:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790971780.002091:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.002098:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f498e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790971780.002390:0:5841:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790971780.002694:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1790971780.002708:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358942237175ns, next at 359942234863ns, rc = 0 00000001:00080000:1.0:1790971780.002718:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1790971780.002771:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8300) 00010000:00010000:1.0:1790971780.002774:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790971780.002793:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f498d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a365 expref: 28 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971780.005213:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:10311:x1877969745245952:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 18202us (18813us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1790971780.005248:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000020:00080000:1.0:1790971780.005258:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790971780.008907:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971780.009000:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745246208 00000100:00100000:1.0:1790971780.009014:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745246208 00000100:00100000:1.0:1790971780.009094:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:1.0:1790971780.009122:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:10311:x1877969745246208:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971780.009157:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971780.009188:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f498ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a36c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.009282:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f498ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a36c expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.009303:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f498ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a36c expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.009326:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971780.009331:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790971780.009336:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43400, rc 0) 00000100:00100000:1.0:1790971780.009414:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:10311:x1877969745246208:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 311us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971780.009422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1790971780.012169:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.012250:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745246464 00000100:00100000:3.0:1790971780.012263:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745246464 00000100:00100000:3.0:1790971780.012343:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:3.0:1790971780.012355:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4832d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:10311:x1877969745246464:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971780.012708:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4832d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:10311:x1877969745246464:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 354us (552us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1790971780.012718:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1790971780.113067:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.113187:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745246720 00000100:00100000:3.0:1790971780.113200:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745246720 00000100:00100000:3.0:1790971780.113285:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1790971780.113297:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:10321:x1877969745246720:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971780.113330:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971780.113359:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f498f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a373 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971780.113524:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790971780.113684:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f498f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a373 expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.113699:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971780.113702:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971780.113722:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f498f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a373 expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.113739:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d200, rc 0) 00000100:00100000:3.0:1790971780.113831:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:10321:x1877969745246720:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 535us (787us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1790971780.113839:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1790971780.120193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.120279:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745246848 00000100:00100000:3.0:1790971780.120293:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745246848 00000100:00100000:3.0:1790971780.120374:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1790971780.120387:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:10321:x1877969745246848:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1790971780.120542:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120565:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120581:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120599:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120606:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120613:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120724:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120755:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120762:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971780.120818:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120833:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120841:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120847:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120853:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971780.120858:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120866:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.120880:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971780.120883:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971780.120890:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121216:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49903 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121245:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121251:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121257:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121263:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971780.121266:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121273:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121282:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd483040900) 00010000:00010000:3.0:1790971780.121285:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971780.121288:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121294:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4990a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121311:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121318:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121324:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121336:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971780.121339:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121346:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121354:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971780.121356:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971780.121359:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.121365:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971780.121607:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:10321:x1877969745246848:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1220us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971780.121618:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:1.0:1790971780.125018:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.125368:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745247104 00000100:00100000:3.0:1790971780.125382:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745247104 00000100:00100000:3.0:1790971780.125456:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1790971780.125506:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:10321:x1877969745247104:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971780.125825:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:10321:x1877969745247104:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 358us (819us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1790971780.125834:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1790971780.168389:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.168552:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745247360 00000100:00100000:3.0:1790971780.168566:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745247360 00000100:00100000:3.0:1790971780.168641:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1790971780.168671:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:10324:x1877969745247360:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971780.168708:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971780.168736:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49918 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a37a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.168832:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.168851:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.168863:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.168879:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.168886:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.168893:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169054:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169079:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169086:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971780.169120:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790971780.169246:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169255:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169262:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169269:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971780.169273:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169282:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169296:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971780.169299:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971780.169304:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169310:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4991f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169327:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169333:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169349:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169354:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971780.169357:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169363:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169371:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd483040900) 00010000:00010000:3.0:1790971780.169374:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971780.169377:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169383:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169437:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49918 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169735:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.169745:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971780.169747:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971780.169750:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d800, rc 0) 00000100:00100000:3.0:1790971780.169840:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:10324:x1877969745247360:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1171us (1467us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1790971780.169860:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:0.0:1790971780.175778:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971780.176150:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745247488 00000100:00100000:1.0:1790971780.176164:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745247488 00000100:00100000:1.0:1790971780.176273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:1.0:1790971780.176288:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:10324:x1877969745247488:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1790971780.176398:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176431:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176635:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176673:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176681:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176689:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176696:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971780.176702:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176712:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176726:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971780.176730:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790971780.176746:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.176753:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4993b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971780.176854:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:10324:x1877969745247488:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 570us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971780.176863:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:2.0:1790971780.179841:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.180005:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745247744 00000100:00100000:3.0:1790971780.180019:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745247744 00000100:00100000:3.0:1790971780.180155:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1790971780.180168:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:10324:x1877969745247744:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971780.180534:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:10324:x1877969745247744:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 367us (707us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1790971780.180542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00010000:00010000:0.0:1790971780.199667:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971780.415245:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.416391:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745248000 00000100:00100000:3.0:1790971780.416408:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745248000 00000100:00100000:3.0:1790971780.416532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1790971780.416544:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:10355:x1877969745248000:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1790971780.416579:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971780.416607:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49942 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a381 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.416735:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49949 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.416753:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.416765:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971780.416777:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790971780.416983:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49942 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a381 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.417026:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a381 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.417037:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971780.417040:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971780.417044:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d200, rc 0) 00000100:00100000:3.0:1790971780.417653:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:10355:x1877969745248000:12345-192.168.203.43@tcp:101:cat.0 Request processed in 1106us (2418us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1790971780.417663:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1790971780.424857:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971780.424922:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971780.424962:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745248256 00000100:00100000:2.0:1790971780.424977:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745248256 00000100:00100000:1.0:1790971780.425026:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745248384 00000100:00100000:1.0:1790971780.425031:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745248384 00000100:00100000:2.0:1790971780.425058:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1790971780.425072:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:10355:x1877969745248256:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:1.0:1790971780.425097:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1790971780.425114:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:2354:x1877969745248384:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971780.425133:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971780.425168:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49949 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a381 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.425193:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971780.425198:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971780.425287:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:2354:x1877969745248384:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 174us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971780.425296:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1790971780.425636:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:10355:x1877969745248256:12345-192.168.203.43@tcp:35:cat.0 Request processed in 566us (793us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1790971780.425644:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1790971780.488393:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.488532:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745248640 00000100:00100000:3.0:1790971780.488545:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745248640 00000100:00100000:3.0:1790971780.488620:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1790971780.488631:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:10361:x1877969745248640:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1790971780.488664:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971780.488668:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790971780.488699:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f498af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a357 expref: 36 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.488724:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971780.488729:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971780.488744:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49957 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a388 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.488863:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.488900:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.488910:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.488950:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.488967:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 36 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971780.488984:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766249600:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971780.489240:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790971780.494056:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.495570:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766249600:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971780.495611:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971780.497534:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745248768 00000100:00100000:0.0:1790971780.497555:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745248768 00010000:00010000:0.0:1790971780.497624:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 37 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971780.497671:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1790971780.497683:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:2356:x1877969745248768:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971780.497704:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971780.497711:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 37 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.497727:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 37 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.497753:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4992d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a37a expref: 37 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.497773:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:0.0:1790971780.497779:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.497791:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.497800:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.497860:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971780.497942:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:2356:x1877969745248768:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 261us (3900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971780.497951:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00010000:00010000:3.0:1790971780.498240:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.498250:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971780.498274:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790971780.498610:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49957 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.498645:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.498654:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971780.498657:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790971780.498660:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d600, rc 0) 00000100:00100000:3.0:1790971780.498707:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:10361:x1877969745248640:12345-192.168.203.43@tcp:101:dd.0 Request processed in 10078us (10328us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1790971780.498715:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1790971780.503358:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971780.503466:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745249024 00000100:00100000:0.0:1790971780.503507:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745249024 00000100:00100000:0.0:1790971780.503582:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1790971780.503593:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:10361:x1877969745249024:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:0.0:1790971780.503964:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.503987:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.504002:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790971780.504065:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1790971780.504093:0:7888:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c0b61f1c reply state 00000000692e2f69 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971780.504117:0:7888:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971780.504243:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:10361:x1877969745249024:12345-192.168.203.43@tcp:36:dd.0 Request processed in 651us (900us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1790971780.504251:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000020:00080000:0.0:1790971780.504258:0:7888:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790971780.509749:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.509772:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.509780:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.509787:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971780.509793:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.509802:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.509821:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971780.509825:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971780.509830:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.509858:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f4996c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971780.842542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971780.844211:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745249152 00000100:00100000:0.0:1790971780.844230:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745249152 00000100:00100000:0.0:1790971780.844327:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1790971780.844358:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:10375:x1877969745249152:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:0.0:1790971780.844393:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971780.844421:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a38f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.844582:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.844601:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.844614:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.844631:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.844637:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.844644:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.845397:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.845416:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.845425:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.845521:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971780.845541:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 39 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971780.845559:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c1ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766249728:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971780.848273:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be3830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971780.862584:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971780.862742:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c1ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766249728:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971780.862778:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971780.866693:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745249408 00000100:00100000:2.0:1790971780.866712:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745249408 00000100:00100000:2.0:1790971780.866805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1790971780.866816:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+40:5594:x1877969745249408:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790971780.867422:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:5594:x1877969745249408:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 606us (4852us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1790971780.867432:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1790971780.869798:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971780.870395:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745249536 00000100:00100000:1.0:1790971780.870409:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745249536 00010000:00010000:1.0:1790971780.870459:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 41 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971780.870580:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1790971780.870591:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:2356:x1877969745249536:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971780.870609:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971780.870616:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 41 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.870631:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 41 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.870656:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4995e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a388 expref: 41 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.870678:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971780.870684:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.870695:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.870704:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.870741:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971780.870820:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+40:2356:x1877969745249536:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 230us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971780.870828:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00010000:00010000:2.0:1790971780.870891:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.870914:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971780.870969:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790971780.870974:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971780.871022:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871037:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871048:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871056:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871073:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871080:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971780.871085:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871094:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871110:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:2.0:1790971780.871114:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971780.871117:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871134:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4997a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871148:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871154:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871160:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871165:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971780.871168:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871173:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871180:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd487fd8500) 00010000:00010000:2.0:1790971780.871183:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971780.871185:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871190:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871229:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a38f expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871243:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a38f expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971780.871255:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:2.0:1790971780.871258:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971780.871260:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd000, rc 0) 00000100:00100000:2.0:1790971780.871287:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:10375:x1877969745249152:12345-192.168.203.43@tcp:101:stat.0 Request processed in 26933us (28762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971780.871294:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1790971780.965225:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766249856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971780.965327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971780.965608:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766249856 00000100:00100000:3.0:1790971780.965620:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766249856 00000100:00100000:3.0:1790971780.965687:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790971780.965698:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877969766249856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971780.965729:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971780.965796:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877969766249856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971780.965805:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790971780.965949:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766249856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971780.968937:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971780.969044:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745249792 00000100:00100000:3.0:1790971780.969584:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745249792 00000100:00100000:3.0:1790971780.969674:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1790971780.969687:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:10381:x1877969745249792:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:3.0:1790971780.969771:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971780.969806:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a38f expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.969831:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971780.969837:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971780.970909:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.970934:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971780.970947:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971780.971074:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1790971780.971127:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c61e276a reply state 000000008aae258e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971780.971138:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971780.971395:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:10381:x1877969745249792:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 1694us (2457us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1790971780.971406:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000020:00080000:3.0:1790971780.971412:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790971780.975981:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.975999:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.976008:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.976013:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971780.976019:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.976027:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.976044:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971780.976047:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971780.976052:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971780.976057:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4998f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971781.161688:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971781.161997:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745249920 00000100:00100000:3.0:1790971781.162011:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745249920 00000100:00100000:3.0:1790971781.162261:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1790971781.162274:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+40:10395:x1877969745249920:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:3.0:1790971781.162313:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971781.162341:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49996 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a396 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.162709:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.162729:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.162745:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.162762:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.162803:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.162811:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163150:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163161:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163169:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971781.163214:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790971781.163220:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971781.163374:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163552:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163564:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163572:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163580:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163601:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971781.163607:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163616:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163632:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971781.163635:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971781.163641:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163648:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4999d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163666:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163672:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163679:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163684:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971781.163687:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163694:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163715:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd483040900) 00010000:00010000:3.0:1790971781.163717:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971781.163721:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163727:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.163774:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49996 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.164139:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.164150:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971781.164153:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971781.164156:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002cc00, rc 0) 00000100:00100000:3.0:1790971781.164445:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:10395:x1877969745249920:12345-192.168.203.43@tcp:101:stat.0 Request processed in 1983us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971781.164455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00080000:0.0:1790971781.165693:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790971781.222269:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971781.258627:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971781.259369:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745250176 00000100:00100000:0.0:1790971781.259394:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745250176 00000100:00100000:0.0:1790971781.259522:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:0.0:1790971781.259534:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:10405:x1877969745250176:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971781.259561:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971781.259587:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f499b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a39d expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971781.260202:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790971781.260376:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f499b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a39d expref: 43 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.260396:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:0.0:1790971781.260399:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790971781.261021:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f499b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a39d expref: 43 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.261043:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd400, rc 0) 00000100:00100000:0.0:1790971781.261224:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:10405:x1877969745250176:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1691us (2611us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1790971781.261233:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1790971781.268372:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.268711:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745250432 00000100:00100000:1.0:1790971781.268725:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745250432 00000100:00100000:1.0:1790971781.268855:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1790971781.268886:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:10405:x1877969745250432:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971781.273548:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+43:10405:x1877969745250432:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 4648us (5176us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1790971781.273566:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1790971781.337718:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971781.338415:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745250688 00000100:00100000:2.0:1790971781.338432:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745250688 00000100:00100000:2.0:1790971781.338551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1790971781.338563:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+43:10411:x1877969745250688:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971781.338598:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971781.338627:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f499c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.338780:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.338798:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.338808:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.338888:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.339017:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 44 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971781.339034:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766249984:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971781.339185:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a6581180 going to sleep for 11 seconds 00000100:00100000:3.0:1790971781.342667:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971781.342853:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766249984:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971781.342901:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971781.344680:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745250816 00000100:00100000:0.0:1790971781.344699:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745250816 00010000:00010000:0.0:1790971781.344766:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 45 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971781.344821:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1790971781.344832:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+45:2357:x1877969745250816:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971781.344853:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971781.344861:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 45 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.344876:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 45 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.344915:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f499ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a396 expref: 45 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.344937:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:0.0:1790971781.344943:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.344977:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.344987:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.345029:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971781.345134:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:2357:x1877969745250816:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 303us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971781.345143:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00010000:00010000:2.0:1790971781.346047:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.346062:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971781.346089:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1790971781.346350:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f499c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.346372:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.346653:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:2.0:1790971781.346657:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790971781.346674:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f200, rc 0) 00000100:00100000:2.0:1790971781.346740:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:10411:x1877969745250688:12345-192.168.203.43@tcp:101:bash.0 Request processed in 8179us (9037us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1790971781.346749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1790971781.352843:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971781.352947:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745251072 00000100:00100000:3.0:1790971781.352960:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745251072 00000100:00100000:3.0:1790971781.353033:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:3.0:1790971781.353045:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:10411:x1877969745251072:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:3.0:1790971781.353423:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.353467:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.353534:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971781.353606:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1790971781.353637:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b69dd7ea reply state 000000003a6eadf1 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971781.353648:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971781.353785:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:10411:x1877969745251072:12345-192.168.203.43@tcp:36:bash.0 Request processed in 739us (953us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1790971781.353794:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000020:00080000:3.0:1790971781.353801:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790971781.358272:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.358296:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.358305:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.358313:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971781.358320:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.358328:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.358351:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:0.0:1790971781.358354:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971781.358360:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.358392:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f499d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971781.361254:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971781.361376:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745251200 00000100:00100000:3.0:1790971781.361690:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745251200 00000100:00100000:3.0:1790971781.361890:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1790971781.361903:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:10411:x1877969745251200:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971781.361939:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971781.361970:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3ab expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.362139:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.362158:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.362180:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.362225:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.362241:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 47 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971781.362258:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766250112:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971781.362372:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4963b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1790971781.364871:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766250112:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971781.364922:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971781.367354:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.367702:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745251328 00000100:00100000:1.0:1790971781.367721:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745251328 00010000:00010000:1.0:1790971781.367778:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971781.367830:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1790971781.367841:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:2355:x1877969745251328:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971781.367862:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971781.367870:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.367885:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.367924:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f499c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3a4 expref: 48 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.367944:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971781.367950:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.367961:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.367989:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.368026:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971781.368115:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:2355:x1877969745251328:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 274us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971781.368123:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00010000:00010000:0.0:1790971781.368987:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.369000:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971781.369073:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790971781.369078:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971781.369115:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.369160:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f499dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ab expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.369180:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ab expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.369189:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:0.0:1790971781.369192:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971781.369209:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d400, rc 0) 00000100:00100000:0.0:1790971781.369269:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:10411:x1877969745251200:12345-192.168.203.43@tcp:101:bash.0 Request processed in 7368us (8031us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971781.369277:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1790971781.376415:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971781.376731:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745251584 00000100:00100000:3.0:1790971781.376745:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745251584 00000100:00100000:3.0:1790971781.376849:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1790971781.376861:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483295050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:10411:x1877969745251584:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1790971781.377214:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483295050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:10411:x1877969745251584:12345-192.168.203.43@tcp:35:bash.0 Request processed in 355us (813us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1790971781.377222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1790971781.476885:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766250496:0@lo:400:kworker.0 00000100:00100000:3.0:1790971781.476992:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971781.477085:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790971781.477092:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766250624:0@lo:400:kworker.0 00000100:00100000:3.0:1790971781.477132:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971781.477169:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766250624 00000100:00100000:3.0:1790971781.477179:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766250624 00000100:00100000:3.0:1790971781.477272:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790971781.477285:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766250624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971781.477352:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766250624:12345-0@lo:400:kworker.0 Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971781.477360:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1790971781.477388:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790971781.477426:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766250624:0@lo:400:kworker.0 00000100:00100000:3.0:1790971781.477459:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766250496 00000100:00100000:3.0:1790971781.477462:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766250496 00000100:00080000:3.0:1790971781.477507:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971781.477537:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790971781.477544:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766250496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971781.477580:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766250496:12345-0@lo:400:kworker.0 Request processed in 37us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971781.477586:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790971781.477608:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766250496:0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.477911:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766250368:0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.477947:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971781.477978:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766250880:0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478005:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971781.478034:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790971781.478040:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766250240:0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478079:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971781.478108:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766250752:0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478129:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971781.478155:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766250880 00000100:00100000:0.0:1790971781.478158:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766250880 00000100:00100000:0.0:1790971781.478187:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790971781.478194:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766250880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478231:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766250880:12345-0@lo:400:kworker.0 Request processed in 37us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971781.478237:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790971781.478265:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766250880:0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478286:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766250368 00000100:00100000:0.0:1790971781.478289:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766250368 00000100:00100000:0.0:1790971781.478308:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766250752 00000100:00100000:0.0:1790971781.478311:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766250752 00000100:00100000:0.0:1790971781.478343:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790971781.478349:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766250368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478401:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766250368:12345-0@lo:400:kworker.0 Request processed in 52us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971781.478407:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790971781.478430:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766250368:0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478446:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790971781.478452:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766250752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971781.478507:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766250752:12345-0@lo:400:kworker.0 Request processed in 55us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971781.478513:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790971781.478532:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766250752:0@lo:400:kworker.0 00000100:00080000:3.0:1790971781.479110:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790971781.479117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971781.480341:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766250240 00000100:00100000:2.0:1790971781.480355:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766250240 00000100:00100000:2.0:1790971781.480428:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790971781.480437:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766250240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971781.480556:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766250240:12345-0@lo:400:kworker.0 Request processed in 120us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971781.480564:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790971781.480628:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766250240:0@lo:400:kworker.0 00000100:00100000:3.0:1790971781.484234:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766251008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971781.484419:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971781.484632:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745251840 00000100:00100000:2.0:1790971781.484644:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745251840 00000100:00100000:2.0:1790971781.484722:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1790971781.484734:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:10421:x1877969745251840:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971781.484769:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971781.484796:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f499ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3b2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971781.485222:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:2.0:1790971781.486580:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790971781.486824:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f499ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3b2 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.486845:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:2.0:1790971781.486848:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971781.486863:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f499ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3b2 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.486883:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5ea00, rc 0) 00000100:00100000:2.0:1790971781.486988:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:10421:x1877969745251840:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2254us (2571us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790971781.486997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1790971781.489408:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766251008 00000100:00100000:2.0:1790971781.489427:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766251008 00000100:00100000:2.0:1790971781.489534:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790971781.489546:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766251008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971781.489603:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971781.489718:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766251008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971781.489725:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790971781.489965:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766251008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971781.490533:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.490718:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745251968 00000100:00100000:1.0:1790971781.490725:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745251968 00000100:00100000:1.0:1790971781.490772:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1790971781.490781:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:10421:x1877969745251968:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:1.0:1790971781.490874:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.490905:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.490920:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.490937:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.490944:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.490951:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491111:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491122:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491129:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790971781.491182:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491196:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491205:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491212:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491219:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971781.491224:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491232:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491246:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971781.491249:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971781.491255:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491268:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f499f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491285:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491291:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491298:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491303:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971781.491306:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491312:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491320:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971781.491323:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971781.491325:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491332:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f499ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491349:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491355:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491366:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491370:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971781.491373:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491632:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491643:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971781.491646:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971781.491649:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.491654:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971781.491787:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:10421:x1877969745251968:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1004us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971781.491797:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1790971781.497585:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.497933:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745252224 00000100:00100000:1.0:1790971781.497947:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745252224 00000100:00100000:1.0:1790971781.498019:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1790971781.498031:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:10421:x1877969745252224:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971781.498344:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:10421:x1877969745252224:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 314us (772us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1790971781.498354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1790971781.550602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971781.550644:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971781.550680:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971781.550911:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745252352 00000100:00100000:3.0:1790971781.550924:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745252352 00000100:00100000:3.0:1790971781.551024:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 290 00000100:00100000:3.0:1790971781.551037:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745252352:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971781.551139:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745252352:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 104us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971781.551164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 290 00000100:00100000:3.0:1790971781.551212:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745252480 00000100:00100000:3.0:1790971781.551216:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745252480 00000100:00100000:3.0:1790971781.551258:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1790971781.551382:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971781.551512:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745252608 00000100:00100000:2.0:1790971781.551517:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745252608 00000100:00100000:2.0:1790971781.551551:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745252864 00000100:00100000:2.0:1790971781.551554:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745252864 00000100:00100000:2.0:1790971781.551577:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:2.0:1790971781.551585:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745252608:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971781.551628:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745252608:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 44us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971781.551636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:2.0:1790971781.551684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:2.0:1790971781.551692:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:10424:x1877969745252864:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971781.551713:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971781.551738:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49a0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3b9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.551835:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.551855:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.551867:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.551884:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.551892:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.551899:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.552052:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49a22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.552062:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.552070:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971781.552105:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790971781.552234:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.552244:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.552251:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.552259:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fa00 already unused, calling callback (ffffffffc20b14f0) 00000100:00100000:3.0:1790971781.553203:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745252480:12345-192.168.203.43@tcp:400:kworker.0 00010000:00010000:2.0:1790971781.553685:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553701:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553718:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:2.0:1790971781.553722:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971781.553728:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553735:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49a14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553753:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553760:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553789:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553795:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971781.553798:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553804:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553812:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd4a656c600) 00010000:00010000:2.0:1790971781.553815:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971781.553818:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553824:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49a1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553906:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49a0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3b9 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553924:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49a22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3b9 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971781.553931:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:2.0:1790971781.553934:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971781.553937:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f800, rc 0) 00000100:00100000:3.0:1790971781.554254:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745252480:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 1062us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971781.554273:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00080000:3.0:1790971781.554312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790971781.554319:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971781.555769:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:10424:x1877969745252864:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 4065us (4375us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1790971781.555802:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:2.0:1790971781.559040:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.559366:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745252992 00000100:00100000:1.0:1790971781.559381:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745252992 00000100:00100000:1.0:1790971781.559463:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:1.0:1790971781.559515:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:10424:x1877969745252992:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1790971781.559606:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559627:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559640:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559674:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559682:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559689:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559697:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971781.559702:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559710:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559723:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971781.559727:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790971781.559732:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.559757:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971781.559858:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:10424:x1877969745252992:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 385us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971781.559866:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:0.0:1790971781.562330:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.562602:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745253248 00000100:00100000:1.0:1790971781.562615:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745253248 00000100:00100000:1.0:1790971781.562680:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1790971781.562690:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:10424:x1877969745253248:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971781.563084:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10424:x1877969745253248:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 393us (766us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1790971781.563101:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1790971781.565851:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.566174:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745253376 00000100:00100000:1.0:1790971781.566188:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745253376 00000100:00100000:1.0:1790971781.566274:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:1.0:1790971781.566285:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:2356:x1877969745253376:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971781.566306:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971781.566339:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49a22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3b9 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.566362:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971781.566368:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971781.566430:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:2356:x1877969745253376:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 147us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971781.566439:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1790971781.735510:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971781.739546:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745253632 00000100:00100000:3.0:1790971781.739569:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745253632 00000100:00100000:3.0:1790971781.741461:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1790971781.741504:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:10443:x1877969745253632:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1790971781.741541:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971781.741569:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49a37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3c0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.741715:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49a3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.741733:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49a3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.741747:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49a3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971781.741759:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790971781.741946:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49a37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3c0 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.741971:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49a3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3c0 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971781.741980:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:3.0:1790971781.741984:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790971781.741988:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c600, rc 0) 00000100:00100000:3.0:1790971781.743803:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:10443:x1877969745253632:12345-192.168.203.43@tcp:101:cat.0 Request processed in 2298us (8294us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1790971781.743818:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:2.0:1790971781.775344:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.775586:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745253760 00000100:00100000:1.0:1790971781.775601:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745253760 00000100:00100000:1.0:1790971781.775674:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:1.0:1790971781.775685:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:10444:x1877969745253760:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971781.775718:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971781.775758:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3c7 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.775847:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49a53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.775864:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.775878:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971781.775921:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790971781.775924:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971781.775945:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.775975:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3c7 expref: 55 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.775998:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3c7 expref: 54 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.776009:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971781.776012:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971781.776032:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43e00, rc 0) 00000100:00100000:1.0:1790971781.776130:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10444:x1877969745253760:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 445us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971781.776138:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:0.0:1790971781.782205:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.782276:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745254144 00000100:00100000:1.0:1790971781.782289:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745254144 00000100:00100000:1.0:1790971781.782356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1790971781.782369:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10444:x1877969745254144:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971781.783157:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10444:x1877969745254144:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 786us (961us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1790971781.783167:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1790971781.789328:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.789530:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745254272 00000100:00100000:1.0:1790971781.789543:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745254272 00000100:00100000:1.0:1790971781.789629:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1790971781.789642:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10444:x1877969745254272:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:1.0:1790971781.789663:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790971781.789698:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f499e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ab expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.789727:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49a3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3c0 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.789822:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f498ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a36c expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.789839:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971781.789852:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971781.789952:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10444:x1877969745254272:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 311us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971781.789961:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1790971781.794613:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971781.794817:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745254400 00000100:00100000:0.0:1790971781.794830:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745254400 00000100:00100000:0.0:1790971781.794914:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:0.0:1790971781.794925:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10444:x1877969745254400:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:0.0:1790971781.795106:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.795128:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971781.795142:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790971781.795729:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790971781.795976:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1790971781.796057:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1790971781.796214:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10444:x1877969745254400:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 1286us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971781.796225:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:0.0:1790971781.816334:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971781.816514:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745254528 00000100:00100000:1.0:1790971781.816528:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745254528 00000100:00100000:1.0:1790971781.816606:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1790971781.816618:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10446:x1877969745254528:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971781.816647:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971781.816685:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49a61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3ce expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816773:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816791:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816805:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816821:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816829:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816834:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816961:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.816992:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817000:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971781.817044:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790971781.817048:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971781.817070:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817082:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817101:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817109:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817116:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817122:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971781.817127:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817135:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817148:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971781.817152:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971781.817164:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817172:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817190:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817196:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817201:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817206:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971781.817208:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817213:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817219:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd48dd1b000) 00010000:00010000:1.0:1790971781.817222:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971781.817225:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817231:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817265:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49a61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 54 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817293:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 53 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971781.817300:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:1.0:1790971781.817303:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971781.817305:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43200, rc 0) 00000100:00100000:1.0:1790971781.817392:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:10446:x1877969745254528:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 775us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971781.817401:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000001:00080000:1.0:1790971782.073746:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967339 is committed 00000001:00080000:1.0:1790971782.073771:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:1.0:1790971782.073781:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1790971782.073794:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd4a07c1900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1790971782.073799:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd49bcc0400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4a07c1240 00000020:00080000:1.0:1790971782.073802:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd49bcc0a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4be15a000 00000020:00080000:0.0:1790971782.074384:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790971782.074529:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1790971782.074975:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766251136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790971782.075043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971782.075968:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766251136 00000100:00100000:2.0:1790971782.075978:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766251136 00000100:00100000:2.0:1790971782.076039:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790971782.076058:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1877969766251136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790971782.076086:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790971782.076131:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6ac00f83, atime: 0x6ac00f84, ctime: 0x6ac00f83, blocks: 0x1 00010000:00010000:2.0:1790971782.076140:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.076157:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1790971782.076162:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971782.076168:0:6689:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.076183:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.076193:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.076218:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.076238:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790971782.076796:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1877969766251136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 746us (1750us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790971782.076804:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790971782.077164:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971782.077173:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.077182:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fe00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971782.077187:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.077209:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.077228:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.077235:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd3198c/0xbd3388eaa6f49a7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.077255:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971782.077257:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971782.077259:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790971782.077300:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd495667480/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790971782.077306:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766251136:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790971782.244698:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790971782.438056:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790971782.438069:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790971782.438163:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790971782.438171:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790971782.438352:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766251264:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790971782.438496:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a0240 going to sleep for 11 seconds 00000100:00100000:3.0:1790971782.441021:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766251264:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790971782.450114:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.457198:0:5850:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745254656 00000100:00100000:1.0:1790971782.457225:0:5850:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745254656 00000100:00100000:1.0:1790971782.457743:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1790971782.457754:0:5850:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10457:x1877969745254656:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790971782.457916:0:5850:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10457:x1877969745254656:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 163us (7825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971782.457925:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:0.0:1790971782.465185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.467391:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745254784 00000100:00100000:1.0:1790971782.467408:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745254784 00000100:00100000:2.0:1790971782.470552:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:2.0:1790971782.470571:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10457:x1877969745254784:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790971782.470636:0:5840:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790971782.470828:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10457:x1877969745254784:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 262us (5655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971782.470837:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:3.0:1790971782.477397:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.477667:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745254912 00000100:00100000:1.0:1790971782.477681:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745254912 00000100:00100000:1.0:1790971782.477756:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1790971782.477766:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10457:x1877969745254912:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790971782.477862:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477884:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477898:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477915:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477922:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477929:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477963:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477973:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.477980:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971782.478027:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790971782.478032:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971782.478055:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478076:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478083:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478101:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478108:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971782.478114:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478123:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478137:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:1.0:1790971782.478140:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971782.478147:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478155:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49a84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478168:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478175:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478182:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478194:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971782.478197:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478204:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478212:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971782.478215:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971782.478218:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478224:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49a8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478239:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478246:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478253:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478258:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971782.478261:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478268:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478384:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:1.0:1790971782.478387:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971782.478391:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.478398:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49a92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971782.478590:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10457:x1877969745254912:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 822us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971782.478599:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1790971782.489458:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.494028:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745255168 00000100:00100000:0.0:1790971782.494132:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745255168 00000100:00100000:0.0:1790971782.495381:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:0.0:1790971782.495401:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:10457:x1877969745255168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971782.495431:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971782.495462:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49a99 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.495636:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.495654:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.495668:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971782.495695:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790971782.497112:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497129:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497137:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497145:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971782.497150:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497159:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497176:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:0.0:1790971782.497179:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971782.497185:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497192:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497371:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49a99 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3d5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497383:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:0.0:1790971782.497386:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790971782.497398:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49a99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3d5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.497409:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd000, rc 0) 00000100:00100000:0.0:1790971782.497524:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745255168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 2129us (8077us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1790971782.497535:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:3.0:1790971782.501371:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971782.503566:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745255296 00000100:00100000:2.0:1790971782.503584:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745255296 00000100:00100000:2.0:1790971782.503661:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:2.0:1790971782.503673:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745255296:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790971782.503720:0:5838:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790971782.503873:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745255296:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 202us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971782.503881:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:3.0:1790971782.509920:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.510162:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745255552 00000100:00100000:1.0:1790971782.510175:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745255552 00000100:00100000:1.0:1790971782.510267:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1790971782.510278:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745255552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971782.510308:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971782.510312:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790971782.510346:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49a53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3c7 expref: 12 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.510374:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971782.510380:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971782.510398:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49aae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790971782.511328:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790971782.511651:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.511670:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.511682:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.511751:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49aae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3dc expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.511771:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3dc expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.511780:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971782.511783:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790971782.511787:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43c00, rc 0) 00000100:00100000:1.0:1790971782.511876:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10457:x1877969745255552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1599us (1970us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790971782.511886:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1790971782.522416:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.522595:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745255808 00000100:00100000:0.0:1790971782.522608:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745255808 00000100:00100000:0.0:1790971782.522689:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:0.0:1790971782.522700:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10457:x1877969745255808:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790971782.522776:0:7888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971782.522810:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3dc expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.522831:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971782.522844:0:7888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790971782.522872:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.522900:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.522913:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.522930:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.522938:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.522955:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523211:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523221:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523230:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523236:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971782.523429:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523440:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523527:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971782.523530:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971782.523535:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523543:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49ac3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523554:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523560:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523573:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523579:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971782.523582:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523589:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523597:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9404bcef (ffff8cd487fd8600) 00010000:00010000:0.0:1790971782.523600:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971782.523602:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.523608:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49aca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9404bcef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971782.523765:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745255808:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1064us (1361us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790971782.523774:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:1.0:1790971782.528076:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.528232:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745255936 00000100:00100000:0.0:1790971782.528256:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745255936 00000100:00100000:0.0:1790971782.528329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:0.0:1790971782.528341:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745255936:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971782.528367:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971782.528397:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49ad1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3e3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.528457:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.528495:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.528509:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.528626:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.528646:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.528656:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:0.0:1790971782.528659:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790971782.528663:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbde00, rc 0) 00000100:00100000:0.0:1790971782.528732:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10457:x1877969745255936:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 394us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971782.528740:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:2.0:1790971782.534532:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.534624:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745256192 00000100:00100000:0.0:1790971782.534636:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745256192 00000100:00100000:0.0:1790971782.535019:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1790971782.535032:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10457:x1877969745256192:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790971782.535162:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.535204:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.535218:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790971782.535638:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1790971782.535651:0:7888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361475179539ns, next at 362475176737ns, rc = 0 00000004:00010000:0.0:1790971782.535748:0:7888:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f954b8e2 reply state 000000002c485a05 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971782.535759:0:7888:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971782.535886:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10457:x1877969745256192:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 855us (1366us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1790971782.535895:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:1.0:1790971782.543780:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:2.0:1790971782.544553:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.544595:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.544604:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.544611:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971782.544618:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.544628:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.544650:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:2.0:1790971782.544654:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790971782.544660:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.544666:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49adf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971782.549037:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745256320 00000100:00100000:3.0:1790971782.549128:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745256320 00000100:00100000:3.0:1790971782.549268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:3.0:1790971782.549279:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10457:x1877969745256320:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971782.549313:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971782.549358:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.549443:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.549459:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.549664:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:3.0:1790971782.549669:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790971782.549673:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002cc00, rc 0) 00000100:00100000:3.0:1790971782.549755:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10457:x1877969745256320:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 478us (5988us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.549763:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1790971782.552883:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.553021:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745256448 00000100:00100000:3.0:1790971782.553035:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745256448 00000100:00100000:3.0:1790971782.553138:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1790971782.553148:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877969745256448:12345-192.168.203.43@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1790971782.553191:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:3.0:1790971782.553228:0:6690:0:(genops.c:1384:class_connect()) connect: client aa9b9adf-df76-49fe-88a5-1de8c4d3a597, cookie 0xbd3388eaa6f49aed 00002000:00100000:3.0:1790971782.553375:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa9b9adf-df76-49fe-88a5-1de8c4d3a597/ffff8cd487b65000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790971782.553390:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790971782.553741:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790971782.553782:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cd487b67000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790971782.553876:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2353:x1877969745256448:12345-192.168.203.43@tcp:8:lhsmtool_posix.0 Request processed in 727us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.553915:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1790971782.556728:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.556817:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745256576 00000100:00100000:0.0:1790971782.556830:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745256576 00000100:00100000:0.0:1790971782.556936:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1790971782.556948:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:0:x1877969745256576:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790971782.557682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1790971782.620016:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1790971782.620040:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000100:00100000:0.0:1790971782.620556:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:0:x1877969745256576:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 63599us (63831us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790971782.620572:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1790971782.626605:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.629363:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745256832 00000100:00100000:3.0:1790971782.629380:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745256832 00000100:00100000:3.0:1790971782.629483:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1790971782.629495:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10457:x1877969745256832:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790971782.629793:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:10457:x1877969745256832:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 298us (3196us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1790971782.629803:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1790971782.640941:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.641007:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745257088 00000100:00100000:0.0:1790971782.641021:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745257088 00000100:00100000:0.0:1790971782.641161:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:0.0:1790971782.641181:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:10457:x1877969745257088:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790971782.641727:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:10457:x1877969745257088:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 546us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971782.641737:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:2.0:1790971782.654154:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.654454:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745257216 00000100:00100000:3.0:1790971782.654508:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745257216 00000100:00100000:3.0:1790971782.654593:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:3.0:1790971782.654604:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:10457:x1877969745257216:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971782.654633:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971782.654661:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.654769:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49afb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.654787:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.654800:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971782.654845:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971782.654883:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.654915:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.654935:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f1 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.654945:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:3.0:1790971782.654948:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790971782.654951:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00000100:00100000:3.0:1790971782.655036:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10457:x1877969745257216:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 433us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.655044:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:1.0:1790971782.662006:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.662167:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745257344 00000100:00100000:3.0:1790971782.662184:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745257344 00000100:00100000:3.0:1790971782.662276:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1790971782.662288:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745257344:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971782.662313:0:8047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971782.662342:0:8047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3f8 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790971782.662377:0:8047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ac00f86, blocks: 0x1 00010000:00010000:3.0:1790971782.662402:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1790971782.662407:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971782.662418:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 6 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.662463:0:8047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 6 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.662513:0:8047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d800, rc 0) 00000100:00100000:3.0:1790971782.662593:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745257344:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 307us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.662601:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1790971782.669246:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971782.669352:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745257600 00000100:00100000:2.0:1790971782.669366:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745257600 00000100:00100000:2.0:1790971782.669442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1790971782.669454:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10457:x1877969745257600:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790971782.669641:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10457:x1877969745257600:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 189us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971782.669649:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:0.0:1790971782.678775:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.682245:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745257728 00000100:00100000:1.0:1790971782.682274:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745257728 00000100:00100000:1.0:1790971782.682359:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1790971782.682371:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:10457:x1877969745257728:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971782.682394:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971782.682420:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a3ff expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.682461:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 7 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.682491:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971782.682497:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971782.682503:0:6689:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.682550:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 7 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.682566:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 7 pid: 8047 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971782.682583:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b7089f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1877969766251392:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971782.682703:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487f26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971782.689114:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.689198:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745257856 00000100:00100000:1.0:1790971782.689211:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745257856 00010000:00010000:1.0:1790971782.689268:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 8 pid: 8047 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971782.689342:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:1.0:1790971782.689353:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745257856:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971782.689374:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971782.689405:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 8 pid: 8047 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.689421:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 8 pid: 8047 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.689454:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971782.689458:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971782.689500:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.689514:0:5826:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.689565:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971782.689583:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b708b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1877969766251520:192.168.203.43@tcp:105: 00000100:00100000:1.0:1790971782.689682:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487f269c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790971782.689800:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c5ff15b/0xbd3388eaa6f49b02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f8 expref: 8 pid: 8047 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971782.689830:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b7089f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1877969766251392:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971782.689858:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.689870:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42400, rc 0) 00000100:00100000:1.0:1790971782.689910:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:10457:x1877969745257728:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 7540us (11150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971782.689919:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:3.0:1790971782.697565:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b708b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1877969766251520:192.168.203.43@tcp:105: 00010000:00010000:3.0:1790971782.697602:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971782.697683:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745257856:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 8330us (8584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.697697:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1790971782.719392:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.719535:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745257984 00000100:00100000:0.0:1790971782.719548:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745257984 00002000:00100000:0.0:1790971782.719611:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cd495664a80 x1877969745257984/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:53/0 lens 504/0 e 0 to 0 dl 1790971793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971782.719625:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd495664a80 with x1877969745257984 ext(0->8) 00002000:00010000:0.0:1790971782.719632:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd495664a80 00000100:00100000:0.0:1790971782.719666:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1790971782.719676:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745257984:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790971782.720557:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745257984:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 876us (1173us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790971782.720570:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:0.0:1790971782.720579:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cd495664a80 x1877969745257984/t4294967302(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:53/0 lens 504/448 e 0 to 0 dl 1790971793 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971782.720590:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd495664a80 with x1877969745257984 ext(0->8) 00002000:00010000:0.0:1790971782.720596:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd495664a80 00000100:00100000:1.0:1790971782.733666:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.738349:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745258112 00000100:00100000:3.0:1790971782.738367:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745258112 00000100:00100000:3.0:1790971782.738451:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:3.0:1790971782.738463:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10457:x1877969745258112:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000040:00080000:2.0:1790971782.795969:0:12000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790971782.795981:0:12000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790971782.796032:0:12000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790971782.796040:0:12000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790971782.803367:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10457:x1877969745258112:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 64889us (69698us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.803386:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000001:00080000:1.0:1790971782.804273:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1790971782.804285:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790971782.804370:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1790971782.804394:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:2.0:1790971782.804600:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790971782.804622:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766251648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790971782.804701:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971782.804776:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766251648 00000100:00100000:2.0:1790971782.804787:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766251648 00000100:00100000:2.0:1790971782.804899:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790971782.804910:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766251648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790971782.805121:0:8047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00000100:00100000:1.0:1790971782.805649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.805682:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745258240 00000100:00100000:1.0:1790971782.805688:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745258240 00000100:00100000:1.0:1790971782.805724:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1790971782.805732:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2354:x1877969745258240:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000020:00080000:0.0:1790971782.806134:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1790971782.806150:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00010000:2.0:1790971782.807258:0:8047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790971782 00002000:00010000:2.0:1790971782.807264:0:8047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790971782.807266:0:8047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790971782 -> 1790971782 00002000:00010000:2.0:1790971782.807268:0:8047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790971782.807456:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766251648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2543us (2750us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790971782.807722:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1790971782.813457:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd495667800/2, rc 0, transno 4294967303 00000100:00100000:3.0:1790971782.813497:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766251648:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1790971782.876445:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1790971782.876502:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1790971782.877813:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2354:x1877969745258240:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 72069us (72155us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971782.879761:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1790971782.890715:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.893289:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745258496 00000100:00100000:3.0:1790971782.893319:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745258496 00000100:00100000:3.0:1790971782.893410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:3.0:1790971782.893423:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10457:x1877969745258496:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790971782.893521:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971782.893557:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49afb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3f1 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.893578:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:3.0:1790971782.893584:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971782.893624:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.893642:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.893654:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971782.894208:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000022886ad3 reply state 0000000079958a04 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971782.894221:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971782.896129:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10457:x1877969745258496:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 2693us (5413us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790971782.896146:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00010000:00010000:0.0:1790971782.903009:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.903030:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.903055:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.903065:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d600 already unused, calling callback (ffffffffc20b14f0) 00000100:00100000:1.0:1790971782.903067:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:0.0:1790971782.903072:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.903082:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.903117:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:0.0:1790971782.903121:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971782.903126:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.903134:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49b10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971782.903956:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745258624 00000100:00100000:3.0:1790971782.903972:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745258624 00000100:00100000:3.0:1790971782.904059:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:3.0:1790971782.904072:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745258624:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790971782.904438:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790971782.904442:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790971782 -> 1790971781 00002000:00010000:3.0:1790971782.904444:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790971780 00002000:00010000:3.0:1790971782.904447:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790971782 -> 1790971781 00002000:00010000:3.0:1790971782.904449:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790971782.904549:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745258624:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 479us (1491us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790971782.904558:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:1.0:1790971782.914435:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.918442:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745258880 00000100:00100000:3.0:1790971782.918463:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745258880 00000100:00100000:3.0:1790971782.918560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:3.0:1790971782.918572:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10457:x1877969745258880:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790971782.918667:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.918688:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.918699:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.918746:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.918762:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 13 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971782.918796:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766251776:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971782.918921:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe90000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971782.937156:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766251776:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971782.937202:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971782.947521:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971782.950652:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745259008 00000100:00100000:0.0:1790971782.950674:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745259008 00010000:00010000:0.0:1790971782.950743:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971782.950848:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1790971782.950859:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:2356:x1877969745259008:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971782.950899:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971782.950908:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.950925:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.950953:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49ad8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3e3 expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.950973:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:0.0:1790971782.950979:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.950990:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.950999:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971782.951079:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971782.951170:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:2356:x1877969745259008:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 311us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971782.951179:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00010000:00010000:3.0:1790971782.955739:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955760:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955802:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955810:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955819:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955827:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971782.955832:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955841:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955862:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:3.0:1790971782.955865:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790971782.955871:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.955877:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971782.956009:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745258880:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 37432us (41578us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790971782.956020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:3.0:1790971782.959768:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971782.960017:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745259136 00000100:00100000:2.0:1790971782.960029:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745259136 00000100:00100000:2.0:1790971782.960581:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1790971782.960595:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2355:x1877969745259136:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790971782.960660:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.960686:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.960695:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971782.960700:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971782.960705:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.960748:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971782.960764:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 7 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971782.960781:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1877969766251904:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971782.960892:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971782.970749:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1877969766251904:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971782.970785:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971782.974438:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971782.975437:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745259264 00000100:00100000:3.0:1790971782.975450:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745259264 00010000:00010000:3.0:1790971782.975521:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 8 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971782.975572:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1790971782.975581:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745259264:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971782.975596:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971782.975618:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 8 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.975633:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 8 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.975656:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49b09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ff expref: 8 pid: 6689 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976041:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971782.976045:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971782.976051:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976079:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976122:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971782.976183:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745259264:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 600us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.976191:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00010000:00010000:3.0:1790971782.976228:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976237:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976264:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976272:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976280:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976288:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fa00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971782.976293:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976314:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976328:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971782.976337:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a45ae88c/0xbd3388eaa6f49b1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971782.976395:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745259136:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 15803us (16640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971782.976404:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1790971782.985708:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971782.985805:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745259520 00000100:00100000:1.0:1790971782.985843:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745259520 00000100:00100000:1.0:1790971782.985919:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:1.0:1790971782.985931:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:10457:x1877969745259520:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790971782.986038:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.986069:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.986092:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.986391:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.986405:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.986414:0:7888:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.986458:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971782.986516:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 13 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971782.986534:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b7088a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766252032:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971782.986650:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971782.990145:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b7088a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766252032:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971782.990184:0:7888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971783.010446:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971783.010591:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745259648 00000100:00100000:2.0:1790971783.010604:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745259648 00010000:00010000:2.0:1790971783.010682:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971783.010729:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1790971783.010741:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:2357:x1877969745259648:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971783.010764:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971783.010773:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.010787:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.010814:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ae6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ea expref: 14 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.010845:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:2.0:1790971783.010852:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.010862:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.010870:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.010911:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971783.010978:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:2357:x1877969745259648:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 239us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971783.010986:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00010000:00010000:2.0:1790971783.011121:0:7888:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.011140:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971783.011360:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1790971783.011569:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1790971783.011626:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1790971783.011760:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766252160:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790971783.011825:0:7888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971783.011859:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971783.011886:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766252160 00000100:00100000:2.0:1790971783.011892:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766252160 00000100:00100000:2.0:1790971783.011946:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790971783.011955:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7888:x1877969766252160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790971783.012037:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7888:x1877969766252160:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971783.012044:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790971783.012092:0:7888:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1790971783.012099:0:7888:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd495667800, transno 4294967303 00000100:00100000:2.0:1790971783.012113:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766252160:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1790971783.012680:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1790971783.012753:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766252288:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790971783.012795:0:7888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971783.012820:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971783.013026:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766252288 00000100:00100000:2.0:1790971783.013032:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766252288 00000100:00100000:2.0:1790971783.013061:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790971783.013069:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7888:x1877969766252288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790971783.013270:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7888:x1877969766252288:12345-0@lo:1000:mdt00_003.0 Request processed in 201us (474us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790971783.013277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790971783.013319:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766252288:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1790971783.013356:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013367:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013374:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013381:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971783.013386:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013395:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013413:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:2.0:1790971783.013417:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971783.013430:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013437:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013512:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013521:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013527:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013532:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971783.013535:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013541:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013550:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:2.0:1790971783.013553:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971783.013557:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013563:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49a5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013588:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013604:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 16 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013623:0:7888:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013653:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 16 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.013671:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 16 pid: 7888 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971783.013686:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766252416:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971783.013758:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483a23480 going to sleep for 11 seconds 00000100:00080000:1.0:1790971783.014385:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790971783.014394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971783.027007:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766252416:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971783.027052:0:7888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971783.028062:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971783.031962:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745259776 00000100:00100000:0.0:1790971783.031983:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745259776 00010000:00010000:0.0:1790971783.032041:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 17 pid: 7888 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971783.032101:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1790971783.032112:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:2356:x1877969745259776:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971783.032202:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971783.032211:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 17 pid: 7888 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971783.032228:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 17 pid: 7888 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971783.032255:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a3ce expref: 17 pid: 7888 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971783.032275:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:0.0:1790971783.032281:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971783.032293:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971783.032301:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971783.032332:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971783.032511:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:2356:x1877969745259776:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 399us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971783.032520:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00010000:00010000:2.0:1790971783.037499:0:7888:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037523:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037541:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037549:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037557:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037564:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971783.037570:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037588:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037609:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:2.0:1790971783.037612:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971783.037618:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037624:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49b33 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037641:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037648:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037654:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037659:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971783.037662:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037667:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037675:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:2.0:1790971783.037677:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790971783.037680:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971783.037698:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49b25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971783.039562:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10457:x1877969745259520:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 53618us (53854us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1790971783.039580:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000020:00080000:2.0:1790971783.039588:0:7888:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790971783.040775:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790971783.040784:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790971783.041214:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790971783.041222:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790971783.058441:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971783.058605:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745260032 00000100:00100000:1.0:1790971783.058619:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745260032 00000100:00100000:1.0:1790971783.058695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1790971783.058706:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10457:x1877969745260032:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790971783.059603:0:5842:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790971783.059735:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1790971783.059789:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971783.059810:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971783.059823:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971783.059833:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971783.059841:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971783.059848:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971783.059880:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790971783.060002:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10457:x1877969745260032:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1294us (1571us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1790971783.060012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:3.0:1790971783.060013:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:1.0:1790971783.060018:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790971783.060022:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971783.060030:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971783.060034:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971783.060054:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971783.060078:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:3.0:1790971783.060081:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790971783.060094:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971783.060101:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49b3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971783.060130:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971783.060132:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971783.060134:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971783.271811:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971784.103604:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971784.103613:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971784.103655:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790971784.103662:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790971784.293125:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790971784.671211:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790971784.671221:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790971784.671260:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790971784.671268:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790971784.829230:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971784.829309:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745260288 00000100:00100000:1.0:1790971784.829319:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745260288 00000100:00100000:1.0:1790971784.829376:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1790971784.829386:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:10475:x1877969745260288:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971784.829422:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971784.829443:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a406 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.829567:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.829582:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.829592:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971784.829604:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790971784.829723:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a406 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.829741:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a406 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.829750:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971784.829764:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790971784.829768:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43e00, rc 0) 00000100:00100000:1.0:1790971784.829825:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:10475:x1877969745260288:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 439us (600us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790971784.829833:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1790971784.837861:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971784.841562:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745260416 00000100:00100000:2.0:1790971784.841576:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745260416 00000100:00100000:2.0:1790971784.841658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:2.0:1790971784.841668:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:10475:x1877969745260416:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:2.0:1790971784.841743:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.841759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.841771:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.841784:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.841792:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.841810:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842035:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842044:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842052:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790971784.842101:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842113:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842120:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842126:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842131:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971784.842136:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842143:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842154:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:2.0:1790971784.842163:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971784.842168:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842175:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842187:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842193:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842200:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842205:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971784.842208:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842213:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842221:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd4a656c200) 00010000:00010000:2.0:1790971784.842223:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971784.842226:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842231:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842245:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842257:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842263:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842268:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971784.842272:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842277:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842285:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd4a656cf00) 00010000:00010000:2.0:1790971784.842287:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971784.842290:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.842295:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49b64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971784.842384:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:10475:x1877969745260416:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 715us (4529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971784.842461:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:2.0:1790971784.906709:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971784.906806:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745260672 00000100:00100000:0.0:1790971784.906816:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745260672 00000100:00100000:0.0:1790971784.906862:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:0.0:1790971784.906871:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:10478:x1877969745260672:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971784.906892:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971784.906912:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49b6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a40d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.906983:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.906997:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907008:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907024:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907031:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907056:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907313:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907323:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907329:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971784.907339:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790971784.907426:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907434:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907441:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907447:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971784.907451:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907458:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907495:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971784.907498:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971784.907510:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907516:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49b72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907528:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907534:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907539:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907544:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbcc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971784.907547:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907552:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907559:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd487fd8600) 00010000:00010000:0.0:1790971784.907562:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971784.907565:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907571:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907609:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49b6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907637:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.907644:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:0.0:1790971784.907646:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971784.907648:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbde00, rc 0) 00000100:00100000:0.0:1790971784.907708:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10478:x1877969745260672:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 837us (1006us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1790971784.907715:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:0.0:1790971784.910922:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971784.910987:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745260800 00000100:00100000:3.0:1790971784.910998:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745260800 00000100:00100000:3.0:1790971784.911055:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:3.0:1790971784.911065:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10478:x1877969745260800:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1790971784.911136:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911152:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911162:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911187:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911194:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911201:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911218:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971784.911222:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911230:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911241:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:3.0:1790971784.911244:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971784.911249:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.911254:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49b8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971784.911327:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10478:x1877969745260800:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 263us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971784.911335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:0.0:1790971784.915342:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971784.915403:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745261056 00000100:00100000:3.0:1790971784.915414:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745261056 00000100:00100000:3.0:1790971784.915539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:3.0:1790971784.915549:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483294c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10478:x1877969745261056:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971784.915767:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483294c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:10478:x1877969745261056:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 219us (433us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790971784.915774:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1790971784.971008:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971784.971131:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745261312 00000100:00100000:2.0:1790971784.971141:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745261312 00000100:00100000:2.0:1790971784.971191:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:2.0:1790971784.971201:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:9998:x1877969745261312:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971784.971237:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971784.971258:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a414 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.971360:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.971374:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.971383:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.971416:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.971430:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 23 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971784.971443:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766252544:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971784.971544:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4812540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971784.974342:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766252544:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971784.974369:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971784.978313:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971784.978519:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745261440 00000100:00100000:1.0:1790971784.978529:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745261440 00010000:00010000:1.0:1790971784.978569:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 24 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971784.978602:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:1.0:1790971784.978611:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:2356:x1877969745261440:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971784.978626:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971784.978632:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 24 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.978644:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 24 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.978663:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49b80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a40d expref: 24 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.978678:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:1.0:1790971784.978683:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.978708:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.978715:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971784.978741:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971784.978794:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:2356:x1877969745261440:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 183us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971784.978802:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00010000:00010000:0.0:1790971784.978878:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.978888:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971784.978908:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790971784.979081:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49b95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.979098:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.979117:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:0.0:1790971784.979120:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790971784.979123:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f800, rc 0) 00000100:00100000:0.0:1790971784.979149:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:9998:x1877969745261312:12345-192.168.203.43@tcp:101:bash.0 Request processed in 7950us (8151us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790971784.979156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:2.0:1790971784.982741:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971784.982942:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745261696 00000100:00100000:3.0:1790971784.982952:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745261696 00000100:00100000:3.0:1790971784.983007:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:3.0:1790971784.983030:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:9998:x1877969745261696:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:3.0:1790971784.983283:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.983299:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971784.983310:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971784.983364:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1790971784.983388:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086f6326c reply state 00000000a216f2fb transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971784.983397:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790971784.983536:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1790971784.983994:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:9998:x1877969745261696:12345-192.168.203.43@tcp:36:bash.0 Request processed in 963us (1259us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1790971784.984002:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000020:00080000:3.0:1790971784.984007:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1790971784.987241:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.987259:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.987284:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.987291:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971784.987295:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.987304:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.987320:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:2.0:1790971784.987323:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971784.987327:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971784.987333:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49baa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971784.988094:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971784.988178:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745261824 00000100:00100000:0.0:1790971784.988189:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745261824 00000100:00100000:0.0:1790971784.988240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:0.0:1790971784.988251:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:9998:x1877969745261824:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971784.988273:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971784.988290:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49bb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a41b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.988346:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a41b expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.988358:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a41b expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.988376:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:0.0:1790971784.988379:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971784.988382:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd400, rc 0) 00000100:00100000:0.0:1790971784.988445:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:9998:x1877969745261824:12345-192.168.203.43@tcp:101:bash.0 Request processed in 195us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971784.988464:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:3.0:1790971784.992164:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971784.996010:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745261952 00000100:00100000:1.0:1790971784.996133:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745261952 00000100:00100000:0.0:1790971784.996331:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1790971784.996342:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:9998:x1877969745261952:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971784.996360:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971784.996384:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a422 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971784.996413:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ac00f85, atime: 0x6ac00f84, ctime: 0x6ac00f85, blocks: 0xb 00010000:00010000:0.0:1790971784.996434:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1790971784.996439:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971784.996448:0:6689:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.996466:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971784.996506:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbcc00, rc 0) 00000100:00100000:0.0:1790971784.996572:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:9998:x1877969745261952:12345-192.168.203.43@tcp:101:bash.0 Request processed in 231us (4417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971784.996579:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00080000:1.0:1790971784.997982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971784.999250:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971784.999604:0:6694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745262080 00000100:00100000:0.0:1790971784.999613:0:6694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745262080 00002000:00010000:0.0:1790971784.999651:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1790971784.999656:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b7088000 with x1877969745262080 ext(0->18446744073709551615) 00002000:00010000:0.0:1790971784.999667:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4b7088000. 00000100:00100000:0.0:1790971784.999708:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:0.0:1790971784.999717:0:6694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745262080:12345-192.168.203.43@tcp:10:bash.0 00002000:00010000:0.0:1790971785.000006:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790971785.000010:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790971781 -> 1790971785 00002000:00010000:0.0:1790971785.000012:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790971780 -> 1790971780 00002000:00010000:0.0:1790971785.000014:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790971781 -> 1790971785 00002000:00010000:0.0:1790971785.000016:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790971785.000091:0:6694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745262080:12345-192.168.203.43@tcp:10:bash.0 Request processed in 373us (846us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790971785.000098:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00002000:00010000:0.0:1790971785.000102:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1790971785.000104:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b7088000 with x1877969745262080 ext(0->18446744073709551615) 00002000:00010000:0.0:1790971785.000109:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4b7088000. 00000001:00080000:2.0:1790971785.101804:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1790971785.101823:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1790971785.102683:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.104551:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745262208 00000100:00100000:0.0:1790971785.104566:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745262208 00000100:00080000:3.0:1790971785.104719:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971785.108680:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:0.0:1790971785.108709:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:10492:x1877969745262208:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1790971785.108788:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.108806:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.108820:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.108836:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.108857:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.108863:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109108:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109118:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109126:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971785.109166:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109178:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109185:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109193:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109199:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.109203:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109210:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109229:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971785.109232:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.109237:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109244:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109256:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109262:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109268:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109272:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.109275:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109280:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109286:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd487fd8e00) 00010000:00010000:0.0:1790971785.109288:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.109291:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109296:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49bc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109321:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109327:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109334:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109338:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbde00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.109341:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109347:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109355:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:0.0:1790971785.109358:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.109360:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.109366:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971785.109449:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:10492:x1877969745262208:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 754us (6772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.109458:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:3.0:1790971785.129729:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971785.129773:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.129856:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745262336 00000100:00100000:0.0:1790971785.129865:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745262336 00002000:00100000:0.0:1790971785.129910:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff8cd4bd8a3800 x1877969745262336/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:56/0 lens 496/0 e 0 to 0 dl 1790971796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971785.129933:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bd8a3800 with x1877969745262336 ext(0->7) 00002000:00010000:0.0:1790971785.129938:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4bd8a3800 00000100:00100000:0.0:1790971785.129973:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1790971785.129982:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745262336:12345-192.168.203.43@tcp:4:bash.0 00000100:00100000:1.0:1790971785.130158:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745262464 00000100:00100000:1.0:1790971785.130164:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745262464 00000100:00100000:1.0:1790971785.130211:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:1.0:1790971785.130221:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2356:x1877969745262464:12345-192.168.203.43@tcp:16:kworker.0 00000100:00100000:0.0:1790971785.130436:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:2356:x1877969745262336:12345-192.168.203.43@tcp:4:bash.0 Request processed in 453us (715us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790971785.130444:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00002000:00100000:0.0:1790971785.130450:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff8cd4bd8a3800 x1877969745262336/t4294967307(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:56/0 lens 496/448 e 0 to 0 dl 1790971796 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971785.130458:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bd8a3800 with x1877969745262336 ext(0->7) 00002000:00010000:0.0:1790971785.130461:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4bd8a3800 00000100:00100000:3.0:1790971785.158757:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.164194:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745262720 00000100:00100000:2.0:1790971785.164213:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745262720 00000100:00100000:2.0:1790971785.164287:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:2.0:1790971785.164296:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:10495:x1877969745262720:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971785.164319:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971785.164339:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49bd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a429 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164434:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164458:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164486:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164503:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164510:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164518:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164749:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164759:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164765:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971785.164775:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790971785.164867:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164888:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164901:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164907:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971785.164911:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164919:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164931:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:2.0:1790971785.164934:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971785.164939:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164945:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164959:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164965:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164970:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164975:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971785.164978:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.164993:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.165001:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd4a656cf00) 00010000:00010000:2.0:1790971785.165003:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971785.165006:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.165012:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49be2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.165059:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49bd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a429 expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.165084:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a429 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.165092:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:2.0:1790971785.165094:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790971785.165096:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e800, rc 0) 00000100:00100000:2.0:1790971785.165166:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:10495:x1877969745262720:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 870us (6418us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1790971785.165173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:1.0:1790971785.171779:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.171865:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745262848 00000100:00100000:2.0:1790971785.171875:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745262848 00000100:00100000:2.0:1790971785.171931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:2.0:1790971785.171952:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:10495:x1877969745262848:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1790971785.172027:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.172045:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.172056:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.172098:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.172112:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 29 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.172127:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766252672:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971785.172218:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971785.183893:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766252672:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971785.183921:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971785.184019:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1790971785.184037:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1790971785.187595:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745262464:12345-192.168.203.43@tcp:16:kworker.0 Request processed in 57366us (57809us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.187610:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1790971785.187711:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971785.187978:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745263104 00000100:00100000:1.0:1790971785.187988:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745263104 00000100:00100000:1.0:1790971785.188033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1790971785.188045:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:5593:x1877969745263104:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790971785.188332:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:5593:x1877969745263104:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 289us (619us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790971785.188338:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:2.0:1790971785.192934:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.193523:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745263232 00000100:00100000:0.0:1790971785.193533:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745263232 00010000:00010000:0.0:1790971785.193574:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971785.193609:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:0.0:1790971785.193618:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:2357:x1877969745263232:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971785.193633:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971785.193640:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.193672:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.193693:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f49b9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a414 expref: 31 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.193709:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:0.0:1790971785.193714:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.193723:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.193732:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.193764:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971785.193825:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:2357:x1877969745263232:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 208us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.193833:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00010000:00010000:2.0:1790971785.193909:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.193918:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.193959:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.193967:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.193974:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.193980:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fe00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971785.193984:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.193991:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.194001:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:2.0:1790971785.194003:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971785.194007:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.194012:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49bf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.194063:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:10495:x1877969745262848:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 22113us (22291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971785.194081:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:2.0:1790971785.205212:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971785.206224:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745263488 00000100:00100000:1.0:1790971785.206252:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745263488 00000100:00100000:1.0:1790971785.206351:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1790971785.206361:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:10495:x1877969745263488:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971785.206712:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:10495:x1877969745263488:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 352us (1510us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790971785.206721:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00010000:00010000:3.0:1790971785.317078:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971785.338216:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.338314:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745263744 00000100:00100000:0.0:1790971785.338324:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745263744 00000100:00100000:0.0:1790971785.338395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:0.0:1790971785.338405:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:10506:x1877969745263744:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:0.0:1790971785.338431:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971785.338452:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a430 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.338576:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.338589:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.338601:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.338615:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.338623:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.338630:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339131:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339142:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339149:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971785.339160:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1790971785.339261:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339269:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339282:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339288:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.339293:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339300:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339313:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971785.339316:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.339321:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339327:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49c05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339553:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339562:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339569:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339574:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.339577:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339594:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339603:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971785.339606:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.339609:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339616:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339665:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49bfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a430 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339680:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a430 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.339687:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:0.0:1790971785.339689:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971785.339692:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbca00, rc 0) 00000100:00100000:0.0:1790971785.340110:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:10506:x1877969745263744:12345-192.168.203.43@tcp:101:cat.0 Request processed in 1704us (1900us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1790971785.340119:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:2.0:1790971785.354969:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971785.355090:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745264000 00000100:00100000:1.0:1790971785.355102:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745264000 00000100:00100000:1.0:1790971785.355154:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1790971785.355163:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:10506:x1877969745264000:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:1.0:1790971785.355412:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:10506:x1877969745264000:12345-192.168.203.43@tcp:35:cat.0 Request processed in 250us (452us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1790971785.355420:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1790971785.376311:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971785.376609:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745264256 00000100:00100000:1.0:1790971785.376619:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745264256 00000100:00100000:1.0:1790971785.376684:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:1.0:1790971785.376693:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:10507:x1877969745264256:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:1.0:1790971785.376750:0:7888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790971785.376777:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a430 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376798:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a429 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376811:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49bb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a41b expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376841:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd487fd8900) 00010000:00010000:1.0:1790971785.376853:0:7888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971785.376883:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376897:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376907:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376922:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376930:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.376936:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.377185:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.377193:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.377200:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790971785.377972:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1790971785.377983:0:7888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364317512591ns, next at 365317509745ns, rc = 0 00010000:00010000:1.0:1790971785.378634:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378649:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378658:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378666:0:7888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378672:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378678:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378761:0:7888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971785.378785:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378791:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378798:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378805:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971785.378809:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378817:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378841:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971785.378844:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790971785.378848:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378854:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49c2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378883:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378889:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378894:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378899:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971785.378902:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378908:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378916:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:1.0:1790971785.378919:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971785.378921:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.378927:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49c21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790971785.378949:0:7888:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008e485248 reply state 00000000a57bef23 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971785.378956:0:7888:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790971785.379145:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:10507:x1877969745264256:12345-192.168.203.43@tcp:36:rm.0 Request processed in 2449us (2841us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1790971785.379154:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00010000:00010000:0.0:1790971785.379967:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971785.379976:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.379984:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971785.379997:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.380004:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.380015:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:0.0:1790971785.380018:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790971785.380089:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.380097:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49c36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.380172:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971785.380174:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971785.380176:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971785.398208:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.398226:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.398233:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.398239:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.398244:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.398253:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.398270:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd48dd1b000) 00010000:00010000:0.0:1790971785.398273:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.398293:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.398299:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49c28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971785.441983:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.442112:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745264512 00000100:00100000:2.0:1790971785.442122:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745264512 00000100:00100000:2.0:1790971785.442179:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:2.0:1790971785.442188:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:10513:x1877969745264512:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971785.442211:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971785.442231:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49c3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a437 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.442340:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.442353:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.442363:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.442377:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.442868:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.442880:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790971785.443869:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790971785.444047:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444058:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444077:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444111:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444118:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444125:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444131:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.444136:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444143:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444154:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971785.444165:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.444170:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444176:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49c44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971785.444190:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ed2fd85a reply state 0000000027a044b6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971785.444199:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790971785.444230:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49c3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444244:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.444251:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971785.444254:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971785.444256:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbde00, rc 0) 00000100:00100000:0.0:1790971785.444374:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:10513:x1877969745264512:12345-192.168.203.43@tcp:101:bash.0 Request processed in 2186us (2400us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790971785.444440:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:3.0:1790971785.449391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:2.0:1790971785.450253:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.450267:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.450293:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.450299:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ec00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971785.450304:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.450311:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.450327:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd4a656c200) 00010000:00010000:2.0:1790971785.450330:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971785.450335:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.450341:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971785.450666:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745264640 00000100:00100000:0.0:1790971785.450675:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745264640 00000100:00100000:0.0:1790971785.450770:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:0.0:1790971785.450781:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745264640:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971785.450797:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971785.450814:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a43e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971785.450849:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971785.450875:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1790971785.450879:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971785.450889:0:6689:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.450910:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.450922:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd000, rc 0) 00000100:00100000:0.0:1790971785.450982:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745264640:12345-192.168.203.43@tcp:101:bash.0 Request processed in 203us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.450990:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00080000:1.0:1790971785.451048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971785.461358:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971785.461625:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745264768 00000100:00100000:3.0:1790971785.461635:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745264768 00000100:00100000:0.0:1790971785.461757:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1790971785.461767:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:10513:x1877969745264768:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971785.461787:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971785.461805:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a445 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.461837:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.461847:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971785.461851:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971785.461879:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.461919:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.461934:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 7 pid: 6689 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971785.461948:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1877969766252800:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971785.463851:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd482c78d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790971785.467376:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.467543:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1877969766252800:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971785.467579:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.467599:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc400, rc 0) 00000100:00100000:0.0:1790971785.467660:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:10513:x1877969745264768:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5893us (6312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.467669:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:2.0:1790971785.467749:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745264896 00000100:00100000:2.0:1790971785.467756:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745264896 00010000:00010000:2.0:1790971785.467790:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 7 pid: 6689 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.467824:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:2.0:1790971785.467832:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745264896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971785.467846:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971785.467868:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 7 pid: 6689 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.467899:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 7 pid: 6689 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.467922:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c9401f9/0xbd3388eaa6f49c60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a43e expref: 7 pid: 6689 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.467938:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971785.467942:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971785.467950:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.467961:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.467998:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.468013:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766252928:192.168.203.43@tcp:105: 00000100:00100000:2.0:1790971785.468081:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe90000 going to sleep for 11 seconds 00000100:00100000:2.0:1790971785.472302:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766252928:192.168.203.43@tcp:105: 00010000:00010000:2.0:1790971785.472326:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971785.472391:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745264896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 4552us (5018us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971785.472402:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:1.0:1790971785.479338:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.481028:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745265152 00000100:00100000:0.0:1790971785.481041:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745265152 00000100:00100000:0.0:1790971785.481268:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1790971785.481279:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:10513:x1877969745265152:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:0.0:1790971785.481738:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:10513:x1877969745265152:12345-192.168.203.43@tcp:35:bash.0 Request processed in 460us (2408us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1790971785.481755:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:1.0:1790971785.718415:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.718602:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745265280 00000100:00100000:0.0:1790971785.718612:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745265280 00000100:00100000:0.0:1790971785.718672:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:0.0:1790971785.718682:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:10529:x1877969745265280:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971785.718704:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971785.718726:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a44c expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.718787:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49c75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.718801:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.718826:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971785.718860:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790971785.718873:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971785.718892:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.718926:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a44c expref: 36 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.718946:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49c75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a44c expref: 35 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.718973:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971785.718976:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971785.718980:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd400, rc 0) 00000100:00100000:0.0:1790971785.719342:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:10529:x1877969745265280:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 659us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.719349:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:3.0:1790971785.731325:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.731515:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745265536 00000100:00100000:0.0:1790971785.731525:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745265536 00000100:00100000:0.0:1790971785.731579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:0.0:1790971785.731588:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:10529:x1877969745265536:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971785.731606:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971785.731627:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a453 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.731748:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.731762:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.731773:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971785.731784:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790971785.731927:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a453 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.731959:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a453 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.731968:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971785.731971:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971785.731975:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbca00, rc 0) 00000100:00100000:0.0:1790971785.732042:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:10529:x1877969745265536:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 455us (727us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1790971785.732049:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:1.0:1790971785.737445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.737557:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745265792 00000100:00100000:2.0:1790971785.737567:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745265792 00000100:00100000:2.0:1790971785.737623:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:2.0:1790971785.737632:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:10529:x1877969745265792:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971785.737656:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971785.737676:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a45a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.737785:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49c98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.737799:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.737810:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971785.737822:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790971785.737977:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49c91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a45a expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.737994:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a45a expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.738003:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8c00) 00010000:00010000:2.0:1790971785.738006:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790971785.738009:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fe00, rc 0) 00000100:00100000:2.0:1790971785.741284:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:10529:x1877969745265792:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 3642us (3836us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1790971785.741311:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:3.0:1790971785.742543:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.742803:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745265920 00000100:00100000:0.0:1790971785.742813:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745265920 00000100:00100000:0.0:1790971785.742879:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1790971785.742888:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:2356:x1877969745265920:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971785.742902:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971785.742923:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a453 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.742939:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971785.742943:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971785.743227:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:2356:x1877969745265920:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 340us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.743235:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1790971785.751615:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.751704:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745266048 00000100:00100000:2.0:1790971785.751715:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745266048 00000100:00100000:2.0:1790971785.751775:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1790971785.751785:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2354:x1877969745266048:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:2.0:1790971785.751832:0:8047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.751854:0:8047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.751862:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971785.751877:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971785.751882:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.751918:0:8047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.751932:0:8047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 6 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.751947:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8047:1877969766253056:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971785.752543:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971785.755394:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8047:1877969766253056:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971785.755437:0:8047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971785.757516:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.757635:0:6695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745266176 00000100:00100000:2.0:1790971785.757645:0:6695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745266176 00002000:00100000:2.0:1790971785.757689:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cd4b7089c00 x1877969745266176/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:56/0 lens 504/0 e 0 to 0 dl 1790971796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790971785.757700:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b7089c00 with x1877969745266176 ext(0->8) 00010000:00010000:2.0:1790971785.757709:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 7 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.757724:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 7 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790971785.757732:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4b7089c00 00000100:00100000:2.0:1790971785.757763:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1790971785.757772:0:6695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745266176:12345-192.168.203.43@tcp:4:lfs.0 00000100:00100000:2.0:1790971785.758445:0:6695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2356:x1877969745266176:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 673us (971us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790971785.758455:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00002000:00100000:2.0:1790971785.758462:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cd4b7089c00 x1877969745266176/t4294967302(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:56/0 lens 504/448 e 0 to 0 dl 1790971796 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790971785.758494:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b7089c00 with x1877969745266176 ext(0->8) 00010000:00010000:2.0:1790971785.758501:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 9 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.758758:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 9 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790971785.758766:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4b7089c00 00000100:00100000:3.0:1790971785.764946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.765056:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745266304 00000100:00100000:0.0:1790971785.765074:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745266304 00010000:00010000:0.0:1790971785.765116:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 9 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971785.765173:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1790971785.765182:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2355:x1877969745266304:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971785.765197:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790971785.765214:0:7634:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790971785.765217:0:7634:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790971785 00002000:00010000:0.0:1790971785.765219:0:7634:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790971785 00002000:00010000:0.0:1790971785.765221:0:7634:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790971785 00010000:00010000:0.0:1790971785.765226:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 9 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.765238:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 9 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.765260:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49c67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a445 expref: 9 pid: 6690 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.765275:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790971785.765279:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790971785.765284:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.765293:0:7634:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.765332:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971785.765399:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2355:x1877969745266304:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 216us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.765408:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00010000:00010000:1.0:1790971785.765700:0:8047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765712:0:8047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765736:0:8047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765755:0:8047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765763:0:8047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765770:0:8047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ec00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971785.765775:0:8047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765783:0:8047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765795:0:8047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.765804:0:8047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff2cde2/0xbd3388eaa6f49ca6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971785.765854:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2354:x1877969745266048:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 14069us (14248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971785.765862:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:3.0:1790971785.772757:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971785.772837:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745266560 00000100:00100000:1.0:1790971785.772847:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745266560 00000100:00100000:1.0:1790971785.772910:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1790971785.772929:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483296c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:10529:x1877969745266560:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:1.0:1790971785.772999:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a45a expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790971785.774716:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1790971785.774754:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1790971785.776818:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1790971785.777313:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.777335:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.777343:0:5841:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.777385:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.777403:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 42 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971785.777417:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b7088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1877969766253184:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971785.777528:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971785.784546:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b7088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1877969766253184:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971785.784577:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971785.786608:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.787593:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745266688 00000100:00100000:2.0:1790971785.787606:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745266688 00010000:00010000:2.0:1790971785.787648:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 43 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.787729:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:2.0:1790971785.787739:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+43:2357:x1877969745266688:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971785.787753:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971785.787760:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 43 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.787773:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 43 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.787797:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49c52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a437 expref: 43 pid: 5840 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.787813:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8c00) 00010000:00010000:2.0:1790971785.787817:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.787826:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.787843:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.787883:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971785.788019:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971785.788037:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790971785.788170:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1790971785.788373:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1790971785.788531:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b7088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766253312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790971785.788589:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971785.788620:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971785.788988:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:2357:x1877969745266688:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1249us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971785.788996:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:2.0:1790971785.790768:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766253312 00000100:00100000:2.0:1790971785.790780:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766253312 00000100:00100000:2.0:1790971785.791045:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790971785.791056:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766253312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790971785.791166:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766253312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 112us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971785.791174:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790971785.791255:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790971785.791331:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1790971785.791338:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1790971785.791359:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd495667480, transno 4294967301 00000100:00100000:0.0:1790971785.791381:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b7088a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766253312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790971785.791878:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1790971785.791960:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495773b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766253440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790971785.792001:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971785.798174:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd482c78180 going to sleep for 11 seconds 00000100:00100000:3.0:1790971785.798311:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766253440 00000100:00100000:3.0:1790971785.798322:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766253440 00000100:00100000:3.0:1790971785.798379:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790971785.798388:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766253440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790971785.798720:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1877969766253440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 332us (6716us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790971785.798728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971785.798993:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495773b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766253440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790971785.799133:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1790971785.799178:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.799190:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.799197:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.799203:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.799208:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.799215:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.799244:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971785.799247:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790971785.799252:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.799257:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49cad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790971785.799431:0:5841:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790971785.799628:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1790971785.799639:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364739168362ns, next at 365739166320ns, rc = 0 00000001:00080000:0.0:1790971785.799646:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1790971785.799680:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971785.799683:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790971785.799689:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f49c98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a45a expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971785.799792:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483296c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+45:10529:x1877969745266560:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 26864us (27043us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1790971785.799801:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000020:00080000:0.0:1790971785.799805:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790971785.802422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.802494:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745266816 00000100:00100000:0.0:1790971785.802502:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745266816 00000100:00100000:0.0:1790971785.802552:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:0.0:1790971785.802561:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+45:10529:x1877969745266816:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971785.802586:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971785.802607:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49cb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a461 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.802680:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a461 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.802695:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a461 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.802715:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971785.802718:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971785.802721:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc400, rc 0) 00000100:00100000:0.0:1790971785.806715:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:10529:x1877969745266816:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 4143us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971785.806728:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:3.0:1790971785.813965:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.817244:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745267072 00000100:00100000:0.0:1790971785.817260:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745267072 00000100:00100000:0.0:1790971785.817406:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1790971785.817416:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:10529:x1877969745267072:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1790971785.817670:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:10529:x1877969745267072:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 254us (3720us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1790971785.817678:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1790971785.906531:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971785.906609:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745267200 00000100:00100000:0.0:1790971785.906618:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745267200 00000100:00100000:0.0:1790971785.906669:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:0.0:1790971785.906677:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:10539:x1877969745267200:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1790971785.906756:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906793:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906805:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906821:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906828:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906834:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906921:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906929:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906937:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971785.906975:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906988:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.906995:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907012:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907203:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.907208:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907217:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907294:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971785.907298:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.907303:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907310:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49cbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907325:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907332:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907339:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907345:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.907348:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907365:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907373:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971785.907376:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.907379:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907386:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907402:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907409:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907416:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907421:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbde00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971785.907425:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907431:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907438:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971785.907441:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971785.907444:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971785.907459:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.907857:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:10539:x1877969745267200:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1177us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971785.907868:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:2.0:1790971785.977129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971785.977266:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745267456 00000100:00100000:3.0:1790971785.977276:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745267456 00000100:00100000:3.0:1790971785.977338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:3.0:1790971785.977349:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:10542:x1877969745267456:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971785.977369:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971785.977391:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a468 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977462:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977514:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977551:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977569:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977577:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977583:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977692:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977701:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977708:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971785.977718:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790971785.977807:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977816:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977824:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977831:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971785.977840:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977849:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977862:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971785.977865:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971785.977870:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977876:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49cd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977888:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977894:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977900:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977905:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971785.977908:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977914:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977922:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd483040900) 00010000:00010000:3.0:1790971785.977924:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971785.977933:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977939:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49cde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977981:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a468 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.977994:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a468 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971785.978002:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:3.0:1790971785.978004:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971785.978007:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002cc00, rc 0) 00000100:00100000:3.0:1790971785.978360:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:10542:x1877969745267456:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1011us (1239us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1790971785.978368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:3.0:1790971785.998010:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971785.998156:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745267584 00000100:00100000:2.0:1790971785.998166:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745267584 00000100:00100000:2.0:1790971785.998221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:2.0:1790971785.998239:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:10542:x1877969745267584:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1790971785.998306:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998323:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998350:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998375:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998382:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998389:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998395:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971785.998399:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998406:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998416:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971785.998420:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971785.998424:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971785.998430:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971785.998723:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:10542:x1877969745267584:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 492us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971785.998730:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:1.0:1790971786.009955:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971786.010449:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745267840 00000100:00100000:0.0:1790971786.010460:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745267840 00000100:00100000:0.0:1790971786.010592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:0.0:1790971786.010602:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:10542:x1877969745267840:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1790971786.010825:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+50:10542:x1877969745267840:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 224us (878us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1790971786.010833:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1790971786.084850:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790971786.084873:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766253568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971786.084960:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971786.085393:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766253568 00000100:00100000:3.0:1790971786.085401:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766253568 00000100:00100000:3.0:1790971786.085464:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790971786.085498:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766253568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971786.085520:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971786.085741:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766253568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 269us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971786.085749:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790971786.085834:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766253568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971786.126459:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971786.126644:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745268096 00000100:00100000:2.0:1790971786.126665:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745268096 00000100:00100000:2.0:1790971786.126719:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:2.0:1790971786.126728:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+50:10552:x1877969745268096:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971786.126750:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971786.126753:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790971786.126778:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49c75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a44c expref: 50 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.126796:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:2.0:1790971786.126800:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971786.126812:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cfa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a46f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.126899:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.126912:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.126921:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971786.126931:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790971786.127070:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49cfa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a46f expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.127089:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a46f expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.127098:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971786.127106:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971786.127109:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fa00, rc 0) 00000100:00100000:2.0:1790971786.127170:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:10552:x1877969745268096:12345-192.168.203.43@tcp:101:bash.0 Request processed in 443us (724us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790971786.127180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:3.0:1790971786.131328:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971786.131369:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971786.131498:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745268224 00000100:00100000:0.0:1790971786.131508:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745268224 00000100:00100000:0.0:1790971786.131586:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1790971786.131595:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:2354:x1877969745268224:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971786.131610:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971786.131632:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f49d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a46f expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.131652:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971786.131656:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971786.131711:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+50:2354:x1877969745268224:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971786.131718:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1790971786.131899:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745268480 00000100:00100000:2.0:1790971786.131903:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745268480 00000100:00100000:2.0:1790971786.131927:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:2.0:1790971786.131934:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+50:10552:x1877969745268480:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:2.0:1790971786.131978:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971786.131990:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a468 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.132003:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971786.132007:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971786.132223:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.132237:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.132246:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971786.132297:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1790971786.132323:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c01a6aa8 reply state 000000006aedc466 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971786.132331:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971786.132384:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10552:x1877969745268480:12345-192.168.203.43@tcp:36:bash.0 Request processed in 449us (1013us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1790971786.132398:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 105 00000020:00080000:2.0:1790971786.132402:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790971786.136545:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.136580:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.136588:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.136594:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971786.136599:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.136608:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.136624:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971786.136628:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971786.136632:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.136638:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f49d0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971786.141350:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971786.141465:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745268608 00000100:00100000:2.0:1790971786.141508:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745268608 00000100:00100000:2.0:1790971786.141563:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:2.0:1790971786.141572:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:10552:x1877969745268608:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971786.141597:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971786.141617:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.141689:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.141703:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.141714:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971786.141740:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790971786.141744:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971786.141761:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.141784:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.141803:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.141829:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971786.141832:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971786.141836:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fc00, rc 0) 00000100:00100000:2.0:1790971786.141895:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10552:x1877969745268608:12345-192.168.203.43@tcp:101:bash.0 Request processed in 322us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.141901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:1.0:1790971786.145110:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971786.145200:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745268864 00000100:00100000:0.0:1790971786.145211:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745268864 00000100:00100000:0.0:1790971786.145266:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1790971786.145274:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:10552:x1877969745268864:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:0.0:1790971786.145564:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:10552:x1877969745268864:12345-192.168.203.43@tcp:35:bash.0 Request processed in 291us (463us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1790971786.145572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1790971786.240526:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971786.240854:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745268992 00000100:00100000:2.0:1790971786.240863:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745268992 00000100:00100000:2.0:1790971786.240923:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:2.0:1790971786.240933:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:10558:x1877969745268992:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971786.240955:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971786.240975:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a47d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.241035:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.241049:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.241058:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971786.241099:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790971786.241103:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971786.241119:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.241154:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a47d expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.241172:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a47d expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.241182:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:2.0:1790971786.241185:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790971786.241189:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e400, rc 0) 00000100:00100000:2.0:1790971786.241251:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10558:x1877969745268992:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 319us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.241258:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:3.0:1790971786.248421:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971786.248957:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745269120 00000100:00100000:2.0:1790971786.248968:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745269120 00000100:00100000:2.0:1790971786.249029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:2.0:1790971786.249038:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10558:x1877969745269120:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971786.249075:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971786.249095:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249152:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249174:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249185:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249212:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249220:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249226:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249306:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49d47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249314:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249321:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971786.249352:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790971786.249356:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971786.249383:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249394:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249402:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249409:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249426:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249431:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971786.249436:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249443:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249742:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:2.0:1790971786.249745:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971786.249750:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249756:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249770:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249776:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249782:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249786:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971786.249789:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249804:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249812:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd4a656c200) 00010000:00010000:2.0:1790971786.249815:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971786.249818:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249823:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249854:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a484 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249865:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a484 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.249871:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971786.249873:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971786.249876:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5ea00, rc 0) 00000100:00100000:2.0:1790971786.249942:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10558:x1877969745269120:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 905us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.249951:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:3.0:1790971786.265425:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971786.268139:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745269248 00000100:00100000:0.0:1790971786.268155:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745269248 00000100:00100000:0.0:1790971786.268235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1790971786.268245:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:2356:x1877969745269248:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971786.268263:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971786.268290:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49d47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a484 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971786.268323:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971786.268328:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971786.268397:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:2356:x1877969745269248:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 153us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971786.268404:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1790971786.272248:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971786.272337:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745269504 00000100:00100000:2.0:1790971786.272346:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745269504 00000100:00100000:2.0:1790971786.272395:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:2.0:1790971786.272404:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10558:x1877969745269504:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971786.272447:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971786.272467:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a48b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.272595:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.272609:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.272618:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.272652:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.272668:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 55 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971786.272683:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766253696:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971786.272782:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a0540 going to sleep for 11 seconds 00000100:00100000:2.0:1790971786.276651:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766253696:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971786.276683:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971786.285112:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971786.285319:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745269632 00000100:00100000:2.0:1790971786.285329:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745269632 00010000:00010000:2.0:1790971786.285369:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 56 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971786.285415:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1790971786.285425:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:2357:x1877969745269632:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971786.285442:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971786.285450:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 56 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.285463:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 56 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.285512:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f49d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a476 expref: 56 pid: 5838 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.285529:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971786.285534:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.285544:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.285552:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.285580:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971786.285632:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:2357:x1877969745269632:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 208us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.285639:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00010000:00010000:3.0:1790971786.287571:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971786.287587:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971786.287606:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790971786.290100:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971786.290128:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971786.290137:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:3.0:1790971786.290140:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790971786.290143:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f200, rc 0) 00000100:00100000:3.0:1790971786.290465:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10558:x1877969745269504:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 18060us (18223us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790971786.290513:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:0.0:1790971786.297776:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971786.297977:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745269888 00000100:00100000:2.0:1790971786.298000:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745269888 00000100:00100000:2.0:1790971786.298174:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1790971786.298184:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10558:x1877969745269888:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:2.0:1790971786.298199:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971786.298223:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49cb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a461 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971786.298240:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971786.298244:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971786.298304:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10558:x1877969745269888:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 122us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.298312:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1790971786.301433:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971786.302284:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270016 00000100:00100000:3.0:1790971786.302296:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270016 00000100:00100000:3.0:1790971786.302349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:3.0:1790971786.302358:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10558:x1877969745270016:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:3.0:1790971786.302486:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971786.302521:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971786.302533:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790971786.302768:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790971786.302851:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10558:x1877969745270016:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 493us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971786.302871:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:3.0:1790971786.306531:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971786.306703:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270144 00000100:00100000:1.0:1790971786.306721:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270144 00000100:00100000:1.0:1790971786.306775:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:1.0:1790971786.306785:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:10558:x1877969745270144:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971786.306804:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971786.306824:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a492 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971786.307034:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971786.307048:0:7888:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 55 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971786.307078:0:7888:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971786.307092:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 55 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971786.307105:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:1.0:1790971786.307107:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790971786.307112:0:7888:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 55 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971786.307118:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43400, rc 0) 00000100:00100000:1.0:1790971786.307306:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10558:x1877969745270144:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 521us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971786.307314:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 111 00010000:00010000:0.0:1790971786.340805:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790971786.596654:0:8041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365536180580ns, next at 366536178285ns, rc = 0 00000100:00100000:1.0:1790971786.596732:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766253824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971786.596802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971786.596948:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766253824 00000100:00100000:2.0:1790971786.596965:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766253824 00000100:00100000:2.0:1790971786.597021:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790971786.597030:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766253824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971786.597050:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1790971786.597109:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766253824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.597116:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790971786.597154:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1790971786.597160:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1790971786.597185:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766253824:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790971786.597417:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971786.597583:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766254080:0@lo:400:kworker.0 00000100:00100000:1.0:1790971786.597619:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971786.597684:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971786.597693:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766253952:0@lo:400:kworker.0 00000100:00100000:2.0:1790971786.597743:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971786.597780:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766253952 00000100:00100000:2.0:1790971786.597785:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766253952 00000100:00100000:2.0:1790971786.597811:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1790971786.597818:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766253952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971786.597855:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766253952:12345-0@lo:400:kworker.0 Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.597862:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1790971786.597895:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766253952:0@lo:400:kworker.0 00000100:00100000:3.0:1790971786.600747:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766254080 00000100:00100000:3.0:1790971786.600766:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766254080 00000100:00100000:3.0:1790971786.600843:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790971786.600851:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766254080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971786.604427:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766254208:0@lo:400:kworker.0 00000100:00100000:2.0:1790971786.604526:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971786.604598:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766254208 00000100:00100000:2.0:1790971786.604606:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766254208 00000100:00080000:2.0:1790971786.604631:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971786.604683:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790971786.604692:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766254208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971786.604758:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766254208:12345-0@lo:400:kworker.0 Request processed in 68us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.604765:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790971786.604801:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766254208:0@lo:400:kworker.0 00000100:00100000:3.0:1790971786.609401:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766254080:12345-0@lo:400:kworker.0 Request processed in 8540us (11771us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971786.609415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790971786.609467:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766254080:0@lo:400:kworker.0 00000100:00100000:3.0:1790971786.619800:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971786.619823:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766254336:0@lo:400:kworker.0 00000100:00100000:3.0:1790971786.619894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971786.620040:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766254336 00000100:00100000:1.0:1790971786.620048:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766254336 00000100:00100000:1.0:1790971786.620124:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790971786.620133:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766254336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971786.620197:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766254336:12345-0@lo:400:kworker.0 Request processed in 66us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971786.620205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1790971786.620258:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971786.620363:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766254336:0@lo:400:kworker.0 00000100:00100000:1.0:1790971786.662152:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971786.662195:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971786.662228:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971786.662265:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971786.662343:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270272 00000100:00100000:3.0:1790971786.662352:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270272 00000100:00100000:3.0:1790971786.662404:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 292 00000100:00100000:3.0:1790971786.662414:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745270272:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971786.662505:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745270272:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 92us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971786.662528:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 292 00000100:00100000:2.0:1790971786.662783:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270528 00000100:00100000:2.0:1790971786.662788:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270528 00000100:00100000:2.0:1790971786.662835:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270400 00000100:00100000:2.0:1790971786.662839:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270400 00000100:00100000:2.0:1790971786.662867:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1790971786.662875:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745270528:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971786.662913:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745270528:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.662919:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1790971786.662932:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1790971786.662938:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745270400:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971786.662961:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745270400:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.662968:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1790971786.662988:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270656 00000100:00100000:2.0:1790971786.662991:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270656 00000100:00100000:2.0:1790971786.663016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:2.0:1790971786.663022:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745270656:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971786.663050:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745270656:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971786.663067:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00080000:1.0:1790971786.663127:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790971786.663132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1790971787.172967:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971787.172976:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971787.173033:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1790971787.173040:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790971787.173169:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766254464:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790971787.173329:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be3839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971787.194638:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971787.194835:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270784 00000100:00100000:2.0:1790971787.194844:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270784 00000100:00100000:2.0:1790971787.194930:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:2.0:1790971787.194940:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745270784:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790971787.195226:0:5840:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790971787.195319:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745270784:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 380us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971787.195326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00080000:3.0:1790971787.202587:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971787.203450:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766254464:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790971787.204688:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.204863:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745270912 00000100:00100000:0.0:1790971787.204873:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745270912 00000100:00100000:0.0:1790971787.204930:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:0.0:1790971787.204939:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10560:x1877969745270912:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790971787.205033:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205061:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205090:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205159:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205168:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205176:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205199:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205208:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205215:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971787.205252:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790971787.205257:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971787.205270:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205281:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205288:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205304:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205310:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbde00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971787.205315:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205323:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205335:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:0.0:1790971787.205338:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971787.205343:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205348:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49d71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205361:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205367:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205373:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205378:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971787.205381:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205395:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205403:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cd487fd8c00) 00010000:00010000:0.0:1790971787.205406:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971787.205408:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205413:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49d78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205427:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205432:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205438:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205442:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971787.205444:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205450:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205456:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971787.205458:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971787.205461:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.205529:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49d7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971787.205605:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10560:x1877969745270912:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 666us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.205613:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:0.0:1790971787.214662:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.215512:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745271168 00000100:00100000:3.0:1790971787.215524:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745271168 00000100:00100000:3.0:1790971787.215594:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:3.0:1790971787.215605:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:10560:x1877969745271168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971787.215626:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971787.215646:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49d86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a499 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215753:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215767:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215777:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971787.215788:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790971787.215885:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215893:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215900:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215925:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971787.215929:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215937:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.215948:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:3.0:1790971787.215951:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790971787.215955:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.216299:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49d8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.216345:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49d86 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a499 expref: 57 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.216357:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:3.0:1790971787.216359:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971787.216363:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49d86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a499 expref: 57 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.216372:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ca00, rc 0) 00000100:00100000:3.0:1790971787.216539:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745271168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 935us (1884us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1790971787.216547:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:1.0:1790971787.239113:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.239748:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745271296 00000100:00100000:0.0:1790971787.239758:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745271296 00000100:00100000:0.0:1790971787.239826:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1790971787.239836:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745271296:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790971787.239873:0:5839:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790971787.240000:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745271296:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 164us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.240012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1790971787.249714:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.249798:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745271552 00000100:00100000:3.0:1790971787.249817:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745271552 00000100:00100000:3.0:1790971787.249884:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:3.0:1790971787.249894:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745271552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971787.249915:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971787.249918:0:7888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790971787.249943:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e400/0xbd3388eaa6f49d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a47d expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.249973:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971787.249978:0:7888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971787.249989:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49d9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4a0 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790971787.250388:0:7888:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1790971787.250616:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.250631:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.250640:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.250687:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49d9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a0 expref: 58 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.250702:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a0 expref: 57 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.250725:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd483040900) 00010000:00010000:3.0:1790971787.250728:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971787.250732:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00000100:00100000:3.0:1790971787.250800:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+57:10560:x1877969745271552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 907us (1104us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1790971787.250808:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:2.0:1790971787.255994:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.256120:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745271808 00000100:00100000:3.0:1790971787.256131:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745271808 00000100:00100000:3.0:1790971787.256189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:3.0:1790971787.256200:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+57:10560:x1877969745271808:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790971787.256276:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971787.256304:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a0 expref: 57 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256323:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd483040900) 00010000:00010000:3.0:1790971787.256334:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971787.256353:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256367:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256376:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256390:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256409:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256417:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256515:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256526:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256533:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256540:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971787.256544:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256552:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256560:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971787.256564:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971787.256567:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256573:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49db0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256583:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256596:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256603:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256608:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971787.256612:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256619:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256627:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xad7faaf6 (ffff8cd483040f00) 00010000:00010000:3.0:1790971787.256629:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971787.256632:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.256638:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49db7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xad7faaf6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.257035:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745271808:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 835us (1049us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790971787.257043:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:2.0:1790971787.260914:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.262825:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745271936 00000100:00100000:1.0:1790971787.262839:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745271936 00000100:00100000:1.0:1790971787.262906:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:1.0:1790971787.262917:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:10560:x1877969745271936:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971787.262938:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971787.262976:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49dbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4a7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.263013:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.263027:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.263039:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.263144:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.263162:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.263170:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:1.0:1790971787.263183:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790971787.263187:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43c00, rc 0) 00000100:00100000:1.0:1790971787.263266:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+57:10560:x1877969745271936:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 351us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971787.263273:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:0.0:1790971787.269440:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971787.270139:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745272192 00000100:00100000:2.0:1790971787.270150:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745272192 00000100:00100000:2.0:1790971787.270207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:2.0:1790971787.270217:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+57:10560:x1877969745272192:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790971787.270301:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.270317:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.270329:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790971787.270635:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1790971787.270791:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e550315 reply state 00000000802f8e59 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.270800:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971787.270910:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:10560:x1877969745272192:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 694us (1479us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790971787.270918:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:2.0:1790971787.284423:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.284520:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745272320 00000100:00100000:3.0:1790971787.284531:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745272320 00000100:00100000:3.0:1790971787.284674:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:3.0:1790971787.284685:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:10560:x1877969745272320:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971787.284837:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971787.284927:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4ae expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.285128:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 60 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.285144:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 60 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.285166:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:3.0:1790971787.285169:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790971787.285173:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d800, rc 0) 00000100:00100000:3.0:1790971787.285521:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:10560:x1877969745272320:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 837us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971787.285530:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00010000:00010000:1.0:1790971787.286257:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.286271:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.286279:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.286300:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971787.286306:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.286314:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.286341:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:1.0:1790971787.286344:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790971787.286348:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.286355:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49dcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.299954:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.303248:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745272448 00000100:00100000:0.0:1790971787.303262:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745272448 00000100:00100000:0.0:1790971787.303387:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1790971787.303399:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745272448:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790971787.305196:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745272448:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 1791us (5245us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790971787.305208:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1790971787.310504:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.310593:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745272704 00000100:00100000:1.0:1790971787.310603:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745272704 00000100:00100000:1.0:1790971787.310660:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1790971787.310670:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:10560:x1877969745272704:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790971787.310918:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:10560:x1877969745272704:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 248us (448us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1790971787.310926:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1790971787.313645:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.314893:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745272960 00000100:00100000:0.0:1790971787.314905:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745272960 00000100:00100000:0.0:1790971787.314974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:0.0:1790971787.314982:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:10560:x1877969745272960:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790971787.315119:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:10560:x1877969745272960:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 137us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.315126:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:2.0:1790971787.318343:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.318436:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745273088 00000100:00100000:1.0:1790971787.318447:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745273088 00000100:00100000:1.0:1790971787.318676:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:1.0:1790971787.318687:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:10560:x1877969745273088:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971787.318708:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971787.318750:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49dda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.318823:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.318838:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.318848:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971787.318893:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971787.318912:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.318938:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f49dda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4b5 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.318956:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4b5 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.318965:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:1.0:1790971787.318968:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790971787.318971:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43600, rc 0) 00000100:00100000:1.0:1790971787.319035:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:10560:x1877969745273088:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 350us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971787.319042:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:1.0:1790971787.327855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.327925:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745273216 00000100:00100000:0.0:1790971787.327936:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745273216 00000100:00100000:0.0:1790971787.327991:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:0.0:1790971787.328001:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2355:x1877969745273216:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971787.328019:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971787.328040:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4bc expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971787.328077:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ac00f8b, blocks: 0x1 00010000:00010000:0.0:1790971787.328096:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1790971787.328100:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971787.328109:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.328126:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.328139:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc400, rc 0) 00000100:00100000:0.0:1790971787.328199:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2355:x1877969745273216:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 199us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.328218:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:2.0:1790971787.336265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.336352:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745273472 00000100:00100000:0.0:1790971787.336361:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745273472 00000100:00100000:0.0:1790971787.336418:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:0.0:1790971787.336428:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:10560:x1877969745273472:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790971787.336728:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:10560:x1877969745273472:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 300us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.336737:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:2.0:1790971787.349341:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.349433:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745273600 00000100:00100000:1.0:1790971787.349459:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745273600 00000100:00100000:1.0:1790971787.349537:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1790971787.349546:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:10560:x1877969745273600:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971787.349565:0:8047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971787.349583:0:8047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4c3 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.349614:0:8047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.349622:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971787.349626:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971787.349631:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 9 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.349665:0:8047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.349678:0:8047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.349692:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8047:1877969766254592:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971787.349791:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be3839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971787.352655:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8047:1877969766254592:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971787.352692:0:8047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 9 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.352715:0:8047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42800, rc 0) 00000100:00100000:3.0:1790971787.352852:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:10560:x1877969745273600:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 3305us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971787.352861:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1790971787.353019:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.353325:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745273728 00000100:00100000:1.0:1790971787.353332:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745273728 00010000:00010000:1.0:1790971787.353365:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.353458:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1790971787.353505:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2356:x1877969745273728:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971787.353520:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971787.353540:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.353552:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.353573:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f3f15a/0xbd3388eaa6f49de8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4bc expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.353586:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971787.353590:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971787.353598:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 8 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.353608:0:7634:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 8 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.353641:0:7634:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 8 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.353654:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7634:1877969766254720:192.168.203.43@tcp:105: 00000100:00100000:1.0:1790971787.353715:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be3839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971787.361515:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7634:1877969766254720:192.168.203.43@tcp:105: 00010000:00010000:1.0:1790971787.361541:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971787.361602:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745273728:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 8134us (8584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971787.361614:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00010000:00010000:3.0:1790971787.364609:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971787.365386:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971787.365495:0:6694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745273856 00000100:00100000:2.0:1790971787.365506:0:6694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745273856 00002000:00100000:2.0:1790971787.365559:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cd49f362300 x1877969745273856/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:58/0 lens 504/0 e 0 to 0 dl 1790971798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790971787.365570:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd49f362300 with x1877969745273856 ext(0->12) 00002000:00010000:2.0:1790971787.365576:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd49f362300 00000100:00100000:2.0:1790971787.365598:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1790971787.365606:0:6694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745273856:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790971787.366676:0:6694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:2356:x1877969745273856:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 1064us (1289us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790971787.366687:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00002000:00100000:2.0:1790971787.366695:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cd49f362300 x1877969745273856/t4294967309(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:58/0 lens 504/448 e 0 to 0 dl 1790971798 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790971787.366705:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd49f362300 with x1877969745273856 ext(0->12) 00002000:00010000:2.0:1790971787.366710:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd49f362300 00000100:00100000:2.0:1790971787.370626:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.370767:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745273984 00000100:00100000:3.0:1790971787.370777:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745273984 00000100:00100000:3.0:1790971787.370837:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:3.0:1790971787.370846:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:10560:x1877969745273984:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790971787.424295:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000004:00080000:1.0:1790971787.424317:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1790971787.424335:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd482c78600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1790971787.424339:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd495b70000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd482c78900 00000020:00080000:1.0:1790971787.424343:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd495b70b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4be15e000 00000001:00080000:1.0:1790971787.424365:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1790971787.424379:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1790971787.424405:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1790971787.424423:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd4957d60c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1790971787.424426:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd386c29900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4957d6a80 00000020:00080000:1.0:1790971787.424429:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd386c29100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4bdd1d400 00000020:00080000:1.0:1790971787.424593:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1790971787.424764:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1790971787.424844:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766254848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790971787.424922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971787.425171:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766254976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790971787.425199:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971787.425247:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766254848 00000100:00100000:1.0:1790971787.425254:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766254848 00000100:00100000:1.0:1790971787.425326:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766254976 00000100:00100000:1.0:1790971787.425330:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766254976 00000100:00100000:1.0:1790971787.425352:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790971787.425360:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1877969766254848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790971787.425384:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1790971787.425415:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ac00f89, atime: 0x6ac00f89, ctime: 0x6ac00f89, blocks: 0x1 00010000:00010000:1.0:1790971787.425424:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.425440:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1790971787.425446:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971787.425453:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.425489:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.425501:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.425508:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.425524:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790971787.426376:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10560:x1877969745273984:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 55526us (55755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971787.426385:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:1.0:1790971787.426544:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1877969766254848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1183us (1621us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790971787.426551:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790971787.426577:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790971787.426587:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766254976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790971787.426607:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1790971787.426624:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426639:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426647:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1790971787.426651:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790971787.426655:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426683:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426698:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 9 pid: 6689 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.426712:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766255104:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971787.426754:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c240 going to sleep for 11 seconds 00000100:00080000:1.0:1790971787.426777:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790971787.426794:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971787.426801:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426820:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971787.426824:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426834:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426850:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.426858:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052007847/0xbd3388eaa6f49df6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790971787.432537:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4c032d880/2, rc 0, transno 4294967304 00000100:00100000:3.0:1790971787.432552:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766254848:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790971787.432781:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971787.432788:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971787.432791:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971787.441387:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.441646:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766255104:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971787.441673:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.441823:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971787.442064:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745274240 00000100:00100000:2.0:1790971787.442073:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745274240 00000100:00100000:2.0:1790971787.442127:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:2.0:1790971787.442137:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4afc14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:2357:x1877969745274240:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790971787.445203:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745274112 00000100:00100000:3.0:1790971787.445217:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745274112 00010000:00010000:3.0:1790971787.445262:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 11 pid: 6689 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971787.445298:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1790971787.445307:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:2357:x1877969745274112:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971787.445320:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971787.445326:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 11 pid: 6689 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.445339:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 11 pid: 6689 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.445360:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b085269e/0xbd3388eaa6f49bb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a422 expref: 11 pid: 6689 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.445377:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971787.445380:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971787.445386:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.445414:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.445445:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971787.445526:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:2357:x1877969745274112:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 220us (4148us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971787.445534:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00010000:00010000:1.0:1790971787.450715:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.450736:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.450749:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.450767:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.450794:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971787.451191:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971787.451198:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.451207:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971787.451212:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.451220:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.451252:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.451259:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003e176f4/0xbd3388eaa6f49dfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.451282:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971787.451284:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971787.451285:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971787.453925:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766254976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27333us (28717us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790971787.453939:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1790971787.454179:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4c032e300/2, rc 0, transno 4294967310 00000100:00100000:0.0:1790971787.454198:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766254976:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1790971787.497142:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1790971787.497164:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1790971787.498346:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4afc14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745274240:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 56204us (56516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971787.498373:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1790971787.501319:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.501402:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745274496 00000100:00100000:3.0:1790971787.501412:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745274496 00000100:00100000:3.0:1790971787.501467:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:3.0:1790971787.501508:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10560:x1877969745274496:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790971787.501562:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971787.501589:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4b5 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.501610:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:3.0:1790971787.501615:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971787.501643:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.501657:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.501667:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971787.502136:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c87d5762 reply state 00000000a6fa6000 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971787.502147:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971787.502248:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:10560:x1877969745274496:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 741us (936us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1790971787.502255:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00010000:00010000:3.0:1790971787.506372:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.506509:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.506517:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.506523:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971787.506528:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.506536:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.506552:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:3.0:1790971787.506555:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971787.506559:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.506565:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.506747:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.506993:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745274624 00000100:00100000:3.0:1790971787.507012:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745274624 00000100:00100000:3.0:1790971787.507076:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1790971787.507086:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745274624:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790971787.507286:0:8047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790971787.507290:0:8047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790971786 00002000:00010000:3.0:1790971787.507292:0:8047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790971785 00002000:00010000:3.0:1790971787.507294:0:8047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790971787 -> 1790971786 00002000:00010000:3.0:1790971787.507297:0:8047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790971787.507358:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745274624:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 274us (615us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790971787.507366:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1790971787.514572:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.514651:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745274880 00000100:00100000:1.0:1790971787.514661:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745274880 00000100:00100000:1.0:1790971787.514714:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:1.0:1790971787.514723:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:10560:x1877969745274880:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790971787.514791:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.514809:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.514819:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.514854:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.514868:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 15 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.514910:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766255232:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971787.515037:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c480 going to sleep for 11 seconds 00000100:00100000:3.0:1790971787.527126:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.527275:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766255232:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971787.527302:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971787.527371:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745275008 00000100:00100000:0.0:1790971787.527378:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745275008 00010000:00010000:0.0:1790971787.527412:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 16 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971787.527448:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:0.0:1790971787.527458:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:2357:x1877969745275008:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971787.527489:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971787.527495:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 16 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.527507:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 16 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.527547:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f49dc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4a7 expref: 16 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.527562:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:0.0:1790971787.527566:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.527577:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.527584:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.527617:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971787.527645:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.527652:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971787.527664:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:2357:x1877969745275008:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 209us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.527671:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00010000:00010000:3.0:1790971787.527678:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.527686:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.527692:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.527706:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971787.527722:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.527731:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.527740:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:3.0:1790971787.527743:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790971787.527747:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.527752:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f49e0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971787.527793:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10560:x1877969745274880:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 13071us (13230us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790971787.528218:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:3.0:1790971787.530808:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971787.532352:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745275136 00000100:00100000:1.0:1790971787.532365:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745275136 00000100:00100000:1.0:1790971787.532430:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:1.0:1790971787.532440:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2355:x1877969745275136:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790971787.532510:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.532530:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 7 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.532538:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971787.532543:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790971787.532547:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.532583:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 7 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.532597:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 7 pid: 8047 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.532626:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766255360:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971787.532713:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1c480 going to sleep for 11 seconds 00000100:00100000:1.0:1790971787.536953:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766255360:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971787.536994:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971787.538289:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.538415:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745275264 00000100:00100000:0.0:1790971787.538425:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745275264 00010000:00010000:0.0:1790971787.538463:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 8 pid: 8047 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971787.538544:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:0.0:1790971787.538554:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745275264:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971787.538569:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971787.538591:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 8 pid: 8047 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.538626:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 8 pid: 8047 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.538649:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005392f798/0xbd3388eaa6f49def lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4c3 expref: 8 pid: 8047 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.538665:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790971787.538670:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790971787.538675:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.538684:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.538720:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971787.538737:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.538747:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.538771:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.538779:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.538788:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.538795:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971787.538799:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971787.538805:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745275264:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 253us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.538813:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00010000:00010000:1.0:1790971787.538819:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.538831:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971787.538839:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dacccf7b/0xbd3388eaa6f49e12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.539163:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745275136:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 6724us (8362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971787.539171:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1790971787.562420:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971787.562523:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745275520 00000100:00100000:2.0:1790971787.562533:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745275520 00000100:00100000:2.0:1790971787.562598:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:2.0:1790971787.562607:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10560:x1877969745275520:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790971787.562679:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.562696:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.562706:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.562933:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.562945:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 15 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.562953:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.562998:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 15 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.563226:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 15 pid: 7888 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.563260:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766255488:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971787.563345:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971787.574163:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766255488:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971787.574197:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971787.584366:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.584514:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745275648 00000100:00100000:0.0:1790971787.584524:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745275648 00010000:00010000:0.0:1790971787.584576:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 16 pid: 7888 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971787.584609:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1790971787.584618:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:2356:x1877969745275648:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971787.584634:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971787.584640:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 16 pid: 7888 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.584653:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 16 pid: 7888 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.584675:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ae expref: 16 pid: 7888 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.584692:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:0.0:1790971787.584698:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.584708:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.584715:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971787.584749:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971787.584804:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:2356:x1877969745275648:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 186us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.584811:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00010000:00010000:2.0:1790971787.584851:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.584869:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971787.585366:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1790971787.585536:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1790971787.585704:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1790971787.585789:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1877969766255616:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790971787.585842:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971787.585872:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790971787.586663:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766255616 00000100:00100000:3.0:1790971787.586673:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766255616 00000100:00100000:3.0:1790971787.586736:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790971787.586745:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1877969766255616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790971787.586827:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1877969766255616:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971787.586835:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790971787.587194:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1877969766255616:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790971787.588201:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1790971787.588277:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1877969766255744:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790971787.588325:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971787.588357:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1790971787.588415:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766255744 00000100:00100000:0.0:1790971787.588422:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766255744 00000100:00100000:0.0:1790971787.588462:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790971787.588499:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1877969766255744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790971787.588677:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1877969766255744:12345-0@lo:1000:mdt00_001.0 Request processed in 207us (351us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1790971787.588688:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790971787.589309:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1877969766255744:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790971787.589344:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589354:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589361:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589379:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ee00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971787.589384:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589392:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589408:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:2.0:1790971787.589410:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971787.589416:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589423:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589453:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589458:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589463:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589486:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971787.589490:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589496:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589514:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971787.589516:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971787.589524:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 18 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589535:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 18 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.589545:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 18 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.590680:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 18 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.590697:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766255872:192.168.203.43@tcp:105: 00000100:00100000:2.0:1790971787.590781:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6840 going to sleep for 11 seconds 00000100:00100000:2.0:1790971787.596136:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766255872:192.168.203.43@tcp:105: 00010000:00010000:2.0:1790971787.596170:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596182:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49d63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596213:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596227:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596253:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596264:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596271:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596277:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596283:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ec00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971787.596287:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596293:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596305:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971787.596308:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971787.596312:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596317:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f49e27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596328:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596334:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596347:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596352:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971787.596355:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596362:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596369:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971787.596372:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790971787.596375:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.596380:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49e19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.596613:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:10560:x1877969745275520:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 34005us (34201us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1790971787.596624:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 127 00000020:00080000:2.0:1790971787.596630:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790971787.596661:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971787.596666:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971787.597182:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790971787.597190:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790971787.601977:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.602031:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971787.602086:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745275776 00000100:00100000:2.0:1790971787.602096:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745275776 00000100:00100000:2.0:1790971787.602138:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745276032 00000100:00100000:2.0:1790971787.602141:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745276032 00000100:00100000:2.0:1790971787.602158:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1790971787.602167:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:10558:x1877969745275776:12345-192.168.203.43@tcp:49:lfs.0 00000100:00100000:2.0:1790971787.602292:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:10558:x1877969745275776:12345-192.168.203.43@tcp:49:lfs.0 Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971787.602314:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1790971787.602331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1790971787.602338:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483297450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:10560:x1877969745276032:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790971787.603076:0:5841:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790971787.603181:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1790971787.603225:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.603241:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.603252:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.603260:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.603266:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.603273:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.603296:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790971787.603372:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483297450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:10560:x1877969745276032:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1032us (1337us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1790971787.603379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000020:00080000:2.0:1790971787.603383:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790971787.604378:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971787.604387:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.604395:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ee00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971787.604399:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.604406:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.604419:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cd4a656cf00) 00010000:00010000:3.0:1790971787.604422:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790971787.604426:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.604431:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49e2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.604450:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971787.604452:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971787.604454:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971787.608635:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.611994:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745276288 00000100:00100000:3.0:1790971787.612956:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745276288 00000100:00100000:0.0:1790971787.613207:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1790971787.613218:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:10558:x1877969745276288:12345-192.168.203.43@tcp:58:lfs.0 00000040:00080000:0.0:1790971787.613454:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1790971787.613568:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:10558:x1877969745276288:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 351us (4944us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971787.613576:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:1.0:1790971787.666253:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971787.666344:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745276416 00000100:00100000:3.0:1790971787.666354:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745276416 00000100:00100000:3.0:1790971787.666416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1790971787.666426:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:10562:x1877969745276416:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971787.666459:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971787.666513:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4ca expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666597:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666612:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666623:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666650:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666657:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666664:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666904:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666916:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666924:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666958:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.666985:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 21 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971787.667000:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766256000:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971787.667103:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971787.685551:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971787.685629:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745276672 00000100:00100000:0.0:1790971787.685639:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745276672 00000100:00100000:0.0:1790971787.685697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1790971787.685706:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:5594:x1877969745276672:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790971787.686317:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:5594:x1877969745276672:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 610us (772us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1790971787.686326:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:3.0:1790971787.686499:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766256000:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971787.686527:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971787.691436:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971787.691556:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745276800 00000100:00100000:2.0:1790971787.691579:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745276800 00010000:00010000:2.0:1790971787.691621:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 23 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971787.691664:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1790971787.691675:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:2356:x1877969745276800:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971787.691689:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971787.691696:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 23 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.691709:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 23 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.691747:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49d55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a48b expref: 23 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.691763:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971787.691769:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.691779:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.691786:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971787.691817:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971787.691885:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:2356:x1877969745276800:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 211us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971787.691902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00010000:00010000:3.0:1790971787.692317:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692327:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971787.692364:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790971787.692368:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971787.692385:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692396:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692405:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692412:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692430:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692436:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971787.692440:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692448:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692457:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:3.0:1790971787.692460:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971787.692463:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692502:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692514:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692521:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692526:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692531:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971787.692534:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692548:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692556:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cd483040900) 00010000:00010000:3.0:1790971787.692559:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971787.692562:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692567:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692600:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f49e35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ca expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692613:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ca expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971787.692620:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:3.0:1790971787.692623:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971787.692625:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c600, rc 0) 00000100:00100000:3.0:1790971787.692660:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10562:x1877969745276416:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 26237us (26418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971787.692667:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00010000:00010000:0.0:1790971788.389086:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790971788.646252:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790971788.646262:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790971788.646319:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790971788.646328:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790971788.646459:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766256128:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790971788.646602:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971788.650839:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766256128:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790971788.655912:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971788.656080:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745276928 00000100:00100000:3.0:1790971788.656090:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745276928 00000100:00100000:3.0:1790971788.656150:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:3.0:1790971788.656160:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10573:x1877969745276928:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790971788.656195:0:7888:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790971788.656285:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10573:x1877969745276928:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 127us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971788.656293:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:1.0:1790971788.661449:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971788.661549:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745277184 00000100:00100000:2.0:1790971788.661563:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745277184 00000100:00100000:2.0:1790971788.661670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:2.0:1790971788.661681:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:10573:x1877969745277184:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971788.661702:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971788.661722:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4d1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.661814:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.661829:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.661841:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971788.661852:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790971788.661970:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4d1 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.661986:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4d1 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.661994:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971788.661997:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971788.662000:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f400, rc 0) 00000100:00100000:2.0:1790971788.662072:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:10573:x1877969745277184:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 392us (632us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790971788.662080:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:1.0:1790971788.677194:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971788.678410:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745277312 00000100:00100000:2.0:1790971788.678421:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745277312 00000100:00100000:2.0:1790971788.678568:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1790971788.678579:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:2356:x1877969745277312:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971788.678596:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971788.678619:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f49e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4d1 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.678637:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971788.678642:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971788.678698:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:2356:x1877969745277312:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 121us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971788.678705:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971788.686920:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971788.688144:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745277568 00000100:00100000:2.0:1790971788.688156:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745277568 00000100:00100000:2.0:1790971788.688318:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:2.0:1790971788.688330:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:10573:x1877969745277568:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790971788.688405:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688422:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688434:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688635:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688644:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688652:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688659:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971788.688664:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688672:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688685:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:2.0:1790971788.688688:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790971788.688692:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971788.688698:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f49e66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971788.688836:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:10573:x1877969745277568:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 508us (1923us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1790971788.688844:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 132 00000040:00080000:3.0:1790971788.690281:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790971788.690288:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790971788.696310:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790971788.696327:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790971788.702278:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971788.703140:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745277824 00000100:00100000:2.0:1790971788.703153:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745277824 00000100:00100000:2.0:1790971788.703221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1790971788.703240:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:10573:x1877969745277824:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790971788.703465:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:10573:x1877969745277824:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 226us (1195us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1790971788.703488:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000040:00080000:1.0:1790971788.756508:0:12106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971788.756517:0:12106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971788.756564:0:12106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790971788.756569:0:12106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790971788.918263:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971788.918801:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278080 00000100:00100000:0.0:1790971788.918811:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278080 00000100:00100000:0.0:1790971788.918898:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:0.0:1790971788.918908:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:10586:x1877969745278080:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971788.918932:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971788.918951:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971788.919105:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49e74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971788.919121:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971788.919133:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971788.919144:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790971788.919264:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f49e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4d8 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971788.919281:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4d8 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971788.919289:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971788.919292:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790971788.919295:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbd400, rc 0) 00000100:00100000:0.0:1790971788.919388:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:10586:x1877969745278080:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 481us (1134us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790971788.919404:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:0.0:1790971788.923054:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971788.924548:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278208 00000100:00100000:1.0:1790971788.924561:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278208 00000100:00100000:1.0:1790971788.924617:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:1.0:1790971788.924627:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:10586:x1877969745278208:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1790971788.924692:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924709:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924720:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924743:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924749:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924755:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924761:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971788.924766:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924772:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924783:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:1.0:1790971788.924785:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790971788.924789:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971788.924805:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971788.924882:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:10586:x1877969745278208:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 256us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971788.925463:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:1.0:1790971789.041578:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971789.041715:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278336 00000100:00100000:3.0:1790971789.041726:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278336 00000100:00100000:3.0:1790971789.041801:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1790971789.041815:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745278336:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1790971789.041834:0:8047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971789.041865:0:8047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000285b906a/0xbd3388eaa6f49e89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4df expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790971789.042151:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1790971789.042232:0:8047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ac00f8a, atime: 0x6ac00f89, ctime: 0x6ac00f8a, blocks: 0xb 00010000:00010000:3.0:1790971789.042256:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1790971789.042261:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971789.042272:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000285b906a/0xbd3388eaa6f49e89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4df expref: 7 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971789.042309:0:8047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000285b906a/0xbd3388eaa6f49e89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4df expref: 7 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971789.042322:0:8047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d600, rc 0) 00000100:00100000:3.0:1790971789.042384:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2355:x1877969745278336:12345-192.168.203.43@tcp:101:cat.0 Request processed in 574us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971789.042392:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1790971789.053218:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971789.054770:0:6695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278464 00000100:00100000:2.0:1790971789.054785:0:6695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278464 00002000:00100000:2.0:1790971789.054836:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8cd4883f3480 x1877969745278464/t0(0) o3->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:60/0 lens 488/0 e 0 to 0 dl 1790971800 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790971789.054858:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4883f3480 with x1877969745278464 ext(0->4095) 00002000:00010000:2.0:1790971789.054865:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4883f3480 00000100:00100000:2.0:1790971789.054947:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:2.0:1790971789.054957:0:6695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745278464:12345-192.168.203.43@tcp:3:cat.0 00000100:00100000:2.0:1790971789.056333:0:6695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745278464:12345-192.168.203.43@tcp:3:cat.0 Request processed in 1372us (3119us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790971789.056344:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00002000:00100000:2.0:1790971789.056353:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8cd4883f3480 x1877969745278464/t0(0) o3->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:60/0 lens 488/4536 e 0 to 0 dl 1790971800 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790971789.056363:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4883f3480 with x1877969745278464 ext(0->4095) 00002000:00010000:2.0:1790971789.056369:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4883f3480 00010000:00010000:0.0:1790971789.419988:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790971790.268635:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1790971790.268652:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1790971790.436576:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971791.206261:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971791.206283:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766256256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971791.206346:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971791.206578:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766256256 00000100:00100000:2.0:1790971791.206587:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766256256 00000100:00100000:2.0:1790971791.206657:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790971791.206681:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766256256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971791.206718:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971791.206765:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766256256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971791.206788:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790971791.206824:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790971791.206829:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1790971791.206846:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4c032d880, transno 4294967304 00000100:00100000:2.0:1790971791.206861:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766256256:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971791.207043:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790971791.465447:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790971791.716632:0:8041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370656158789ns, next at 371656156287ns, rc = 0 00000100:00100000:3.0:1790971791.716662:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766256384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971791.716733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971791.716948:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766256384 00000100:00100000:2.0:1790971791.716956:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766256384 00000100:00100000:2.0:1790971791.717030:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790971791.717040:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766256384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971791.717073:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971791.717117:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766256384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971791.717135:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1790971791.717220:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971791.717254:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766256384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971791.717358:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766256768:0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.717387:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971791.717420:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790971791.717426:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766256640:0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.717449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971791.717496:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766256768 00000100:00100000:3.0:1790971791.717500:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766256768 00000100:00100000:3.0:1790971791.717532:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766256640 00000100:00100000:3.0:1790971791.717535:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766256640 00000100:00100000:3.0:1790971791.717555:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790971791.717562:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766256768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.717617:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877969766256768:12345-0@lo:400:kworker.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971791.717623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790971791.717638:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790971791.717644:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766256640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.717671:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766256640:12345-0@lo:400:kworker.0 Request processed in 27us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971791.717676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1790971791.717698:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971791.717714:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766256640:0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.717723:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766256768:0@lo:400:kworker.0 00000100:00100000:0.0:1790971791.718908:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766256512:0@lo:400:kworker.0 00000100:00100000:0.0:1790971791.718963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971791.719034:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790971791.719048:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766256896:0@lo:400:kworker.0 00000100:00100000:0.0:1790971791.719072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971791.719703:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766256512 00000100:00100000:3.0:1790971791.719712:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766256512 00000100:00100000:3.0:1790971791.719762:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790971791.719770:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766256512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.719828:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766256512:12345-0@lo:400:kworker.0 Request processed in 59us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971791.719835:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790971791.719890:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766256512:0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.719915:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766256896 00000100:00100000:3.0:1790971791.719919:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766256896 00000100:00100000:3.0:1790971791.719951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790971791.719958:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766256896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971791.719993:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766256896:12345-0@lo:400:kworker.0 Request processed in 35us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971791.720012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1790971791.720042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971791.720062:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766256896:0@lo:400:kworker.0 00000100:00100000:0.0:1790971791.786615:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971791.786659:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971791.786689:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971791.786717:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971791.786740:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971791.786780:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745279104 00000100:00100000:0.0:1790971791.786790:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745279104 00000100:00100000:0.0:1790971791.786847:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278720 00000100:00100000:0.0:1790971791.786851:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278720 00000100:00100000:0.0:1790971791.786873:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:0.0:1790971791.786882:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745279104:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971791.786955:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2356:x1877969745279104:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971791.786974:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:0.0:1790971791.786992:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:0.0:1790971791.787000:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:2356:x1877969745278720:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971791.787042:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:2356:x1877969745278720:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971791.787049:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:0.0:1790971791.787073:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278848 00000100:00100000:0.0:1790971791.787076:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278848 00000100:00100000:0.0:1790971791.787102:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278976 00000100:00100000:0.0:1790971791.787105:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278976 00000100:00100000:0.0:1790971791.787129:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1790971791.787136:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745278848:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971791.787163:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745278848:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971791.787170:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1790971791.787183:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1790971791.787190:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745278976:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971791.787213:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745278976:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971791.787219:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00080000:0.0:1790971791.787233:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971791.787237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790971791.787240:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971791.787457:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745278592 00000100:00100000:1.0:1790971791.787462:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745278592 00000100:00100000:1.0:1790971791.787520:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 294 00000100:00100000:1.0:1790971791.787528:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745278592:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971791.787565:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2356:x1877969745278592:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971791.787572:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 294 00010000:00010000:2.0:1790971792.487932:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790971792.832816:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1790971792.832838:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1790971792.861208:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1790971792.861230:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:3.0:1790971792.861246:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1790971792.861271:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd4957d6f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1790971792.861276:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4887a8a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4957d69c0 00000020:00080000:3.0:1790971792.861278:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4887a8100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4c0311000 00000100:00100000:0.0:1790971792.861571:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971792.861590:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766257024:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1790971792.861611:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:0.0:1790971792.861674:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790971792.861818:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1790971792.861927:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766257024 00000100:00100000:2.0:1790971792.861935:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766257024 00000100:00100000:2.0:1790971792.861983:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790971792.861993:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766257024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790971792.862303:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790971792.862313:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790971786 -> 1790971786 00002000:00010000:2.0:1790971792.862316:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1790971785 -> 1790971785 00002000:00010000:2.0:1790971792.862318:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790971786 -> 1790971786 00002000:00010000:2.0:1790971792.862320:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790971792.862372:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766257024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 380us (700us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790971792.862380:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790971792.862535:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1790971792.862540:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4c032e300, transno 4294967310 00000004:00080000:0.0:1790971792.862556:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1790971792.862577:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cd4be0df480 x1877969766257024/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790971808 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790971792.862587:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4be0df480/2, rc 0, transno 4294967313 00000100:00100000:0.0:1790971792.862592:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766257024:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1790971793.512618:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971794.533736:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971794.852786:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971794.852795:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971794.853141:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1790971794.853148:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790971794.909700:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971794.909791:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745279232 00000100:00100000:3.0:1790971794.909801:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745279232 00000100:00100000:3.0:1790971794.909876:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:3.0:1790971794.909886:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10238:x1877969745279232:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790971794.910015:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10238:x1877969745279232:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 130us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971794.910024:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00080000:0.0:1790971794.910091:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971794.923306:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971794.923508:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745279488 00000100:00100000:2.0:1790971794.923518:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745279488 00000100:00100000:2.0:1790971794.923575:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1790971794.923585:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:10238:x1877969745279488:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790971794.923896:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:10238:x1877969745279488:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 311us (598us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1790971794.923904:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00010000:00010000:2.0:1790971795.556886:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971796.324801:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971796.324838:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766257152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971796.324952:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971796.325106:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766257152 00000100:00100000:2.0:1790971796.325118:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766257152 00000100:00080000:1.0:1790971796.325331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971796.325565:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790971796.325580:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766257152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971796.325618:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971796.325707:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766257152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971796.325717:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790971796.326053:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766257152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790971796.584412:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971796.839179:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766257280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971796.839286:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971796.839393:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766257280 00000100:00100000:0.0:1790971796.839404:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766257280 00000100:00100000:0.0:1790971796.839492:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790971796.839505:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766257280:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790971796.839701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1790971796.839837:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971796.839958:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766257280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 456us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971796.840741:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790971796.841904:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766257408:0@lo:400:kworker.0 00000100:00100000:0.0:1790971796.842002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971796.842051:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971796.842057:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766257536:0@lo:400:kworker.0 00000100:00100000:0.0:1790971796.842090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971796.842339:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766257536 00000100:00100000:0.0:1790971796.842348:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766257536 00000100:00100000:0.0:1790971796.842402:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790971796.842412:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766257536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971796.842502:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766257536:12345-0@lo:400:kworker.0 Request processed in 91us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971796.842509:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790971796.842560:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766257536:0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843260:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766257664:0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971796.843353:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971796.843361:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766257792:0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843387:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971796.843421:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766257664 00000100:00100000:3.0:1790971796.843426:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766257664 00000100:00100000:3.0:1790971796.843495:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766257792 00000100:00100000:3.0:1790971796.843499:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766257792 00000100:00100000:3.0:1790971796.843537:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790971796.843544:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766257664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843588:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766257664:12345-0@lo:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971796.843595:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790971796.843612:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790971796.843618:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766257792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843644:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766257792:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971796.843650:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1790971796.843670:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971796.843693:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766257792:0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843703:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766257664:0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843814:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766257408 00000100:00100000:3.0:1790971796.843819:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766257408 00000100:00100000:3.0:1790971796.843846:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790971796.843853:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766257408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971796.843892:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766257408:12345-0@lo:400:kworker.0 Request processed in 39us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971796.843898:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790971796.844014:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766257408:0@lo:400:kworker.0 00000100:00100000:2.0:1790971796.847908:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766257280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971796.905181:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971796.905239:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971796.905281:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971796.905314:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745279872 00000100:00100000:2.0:1790971796.905328:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971796.905330:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745279872 00000100:00100000:2.0:1790971796.905368:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971796.905401:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745280128 00000100:00100000:2.0:1790971796.905407:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745280128 00000100:00100000:3.0:1790971796.905421:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745280000 00000100:00100000:3.0:1790971796.905426:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745280000 00000100:00100000:2.0:1790971796.905450:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745279744 00000100:00100000:2.0:1790971796.905454:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745279744 00000100:00100000:3.0:1790971796.905513:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1790971796.905524:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:2.0:1790971796.905541:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745280128:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971796.905545:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745279872:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971796.905659:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745279616 00000100:00100000:0.0:1790971796.905664:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745279616 00000100:00100000:0.0:1790971796.905697:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 296 00000100:00100000:0.0:1790971796.905705:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745279616:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971796.905776:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:1.0:1790971796.905787:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:2357:x1877969745279744:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971796.905867:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745280128:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 333us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971796.905876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:2.0:1790971796.905907:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:2.0:1790971796.905915:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745280000:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971796.909634:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745279872:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 4073us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971796.909657:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00080000:3.0:1790971796.909728:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790971796.909737:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790971796.909740:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790971796.912185:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745279616:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 6462us (7003us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971796.912204:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 296 00000100:00100000:1.0:1790971796.912391:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:2357:x1877969745279744:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 6602us (7058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971796.912403:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:2.0:1790971796.912799:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745280000:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 6879us (7426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971796.912811:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000001:02000400:2.0:1790971797.161380:0:12307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:09:55 (1790971795) 00010000:00010000:0.0:1790971797.605374:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790971797.945150:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1790971797.945188:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1790971797.945611:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1790971797.945624:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1790971797.950138:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:2.0:1790971798.546430:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971798.546563:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745280384 00000100:00100000:3.0:1790971798.546578:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745280384 00000100:00100000:3.0:1790971798.546729:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:3.0:1790971798.546744:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:11297:x1877969745280384:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971798.546774:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971798.546801:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4e6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.546912:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.546931:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.546946:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.546963:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.546980:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547014:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547363:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49ea5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547374:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547382:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971798.547394:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790971798.547634:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547644:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547652:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547659:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971798.547664:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547673:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547687:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cd487fd8200) 00010000:00010000:3.0:1790971798.547691:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971798.547704:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547710:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49e97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547726:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547733:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547739:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547745:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971798.547748:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547754:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547761:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cd483040600) 00010000:00010000:3.0:1790971798.547764:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971798.547767:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.547773:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49e9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.548301:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49e90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4e6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.548331:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4e6 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971798.548340:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:3.0:1790971798.548342:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971798.548345:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c800, rc 0) 00000100:00100000:3.0:1790971798.548449:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:11297:x1877969745280384:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1709us (2034us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790971798.548460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00080000:0.0:1790971798.549004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971798.558015:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971798.558154:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745280512 00000100:00100000:3.0:1790971798.558168:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745280512 00000100:00100000:3.0:1790971798.558250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:3.0:1790971798.558262:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:11297:x1877969745280512:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790971798.558424:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:11297:x1877969745280512:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 164us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971798.558433:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:2.0:1790971798.564124:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971798.564339:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745280640 00000100:00100000:0.0:1790971798.564355:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745280640 00000100:00100000:0.0:1790971798.566569:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1790971798.566598:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:2355:x1877969745280640:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971798.566628:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971798.566663:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49ea5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4e6 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971798.566687:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:0.0:1790971798.566711:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971798.566784:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:2355:x1877969745280640:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 202us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971798.566792:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00010000:00010000:2.0:1790971798.634519:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971798.956752:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971798.956777:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971798.957308:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790971798.957320:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790971799.653245:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971800.677042:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971800.781113:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971800.781273:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745280768 00000100:00100000:3.0:1790971800.781287:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745280768 00000100:00100000:3.0:1790971800.781386:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:3.0:1790971800.781401:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:11339:x1877969745280768:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971800.781430:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971800.781467:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4ed expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790971800.781504:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790971800.781573:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781599:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781613:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781630:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781636:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781643:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781964:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781973:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781982:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.781999:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971800.782004:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782012:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782027:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971800.782036:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971800.782042:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782050:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782063:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782069:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782076:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782081:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971800.782084:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782089:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782096:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cd483040600) 00010000:00010000:3.0:1790971800.782099:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971800.782101:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782106:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ec1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782141:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49eb3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ed expref: 15 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782164:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971800.782166:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971800.782170:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ed expref: 15 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.782180:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ca00, rc 0) 00000100:00100000:3.0:1790971800.782263:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:11339:x1877969745280768:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 867us (1159us total) trans 0 rc 301/301 00000100:00100000:3.0:1790971800.782271:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1790971800.803357:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971800.806682:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745281024 00000100:00100000:3.0:1790971800.806706:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745281024 00000100:00100000:3.0:1790971800.806870:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:3.0:1790971800.806885:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:11339:x1877969745281024:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:3.0:1790971800.806975:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971800.807013:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4983f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a32d expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.807034:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971800.807047:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971800.807326:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.807345:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.807356:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.807382:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.807390:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.807397:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971800.808401:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790971800.808417:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.808428:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.808436:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.808443:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971800.808448:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.808457:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.808495:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:3.0:1790971800.808498:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971800.808503:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.808520:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ec8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971800.808539:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e363fbc2 reply state 0000000085b05b76 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971800.808549:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971800.808680:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:11339:x1877969745281024:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 1794us (5336us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1790971800.808690:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00010000:00010000:2.0:1790971800.821425:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.821448:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.821457:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.821464:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971800.821483:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.821493:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.821514:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cd483040100) 00010000:00010000:2.0:1790971800.821518:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971800.821524:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.821531:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49ecf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971800.898281:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971800.898384:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745281152 00000100:00100000:3.0:1790971800.898400:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745281152 00000100:00100000:3.0:1790971800.898506:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:3.0:1790971800.898520:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+14:11347:x1877969745281152:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:3.0:1790971800.898557:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971800.898593:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ed6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4f4 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.898688:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49edd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.898706:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.898722:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971800.899153:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790971800.899158:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971800.899200:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.899309:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49ed6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4f4 expref: 16 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.899339:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49edd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4f4 expref: 15 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.899350:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:3.0:1790971800.899353:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971800.899358:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c200, rc 0) 00000100:00100000:3.0:1790971800.899563:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:11347:x1877969745281152:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 1045us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971800.899572:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:0.0:1790971800.951672:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971800.951800:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745281280 00000100:00100000:2.0:1790971800.951814:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745281280 00000100:00100000:2.0:1790971800.951893:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:2.0:1790971800.951906:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+15:11353:x1877969745281280:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971800.951934:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971800.951974:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49ee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a4fb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952098:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952119:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952134:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952152:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952159:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952165:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952559:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952582:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971800.952597:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971800.952724:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790971800.952730:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971800.952758:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952771:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952779:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952786:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952793:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ee00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971800.952798:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952806:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952821:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:0.0:1790971800.952833:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971800.952840:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952846:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f49eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952865:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952871:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952878:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952884:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971800.952886:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952892:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952901:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cd4a656c700) 00010000:00010000:0.0:1790971800.952904:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971800.952907:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952913:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f49ef2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.952974:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f49ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4fb expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.953005:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4fb expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.953013:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971800.953015:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790971800.953018:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e800, rc 0) 00000100:00100000:0.0:1790971800.953105:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:11353:x1877969745281280:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1200us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971800.953114:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:1.0:1790971800.955860:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971800.956013:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745281536 00000100:00100000:3.0:1790971800.956026:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745281536 00000100:00100000:3.0:1790971800.956107:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:3.0:1790971800.956118:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+16:11353:x1877969745281536:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971800.956142:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971800.956168:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49f00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a502 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.956323:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.956340:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.956384:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.956595:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.956621:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.956637:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790971800.957330:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790971800.957544:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957557:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957566:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957602:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957611:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957619:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957625:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971800.957637:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957645:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957658:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:3.0:1790971800.957662:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971800.957667:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957673:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971800.957687:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c7acc53a reply state 0000000060b0dacd transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971800.957697:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790971800.957740:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49f00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957755:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.957764:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040400) 00010000:00010000:3.0:1790971800.957766:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971800.957768:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c800, rc 0) 00000100:00100000:3.0:1790971800.957842:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11353:x1877969745281536:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1726us (1998us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1790971800.957851:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 142 00010000:00010000:3.0:1790971800.977712:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.977730:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.977748:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.977755:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971800.977760:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.977768:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.977784:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd483040a00) 00010000:00010000:3.0:1790971800.977787:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971800.977792:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.977799:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f49f0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971800.978110:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971800.978185:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745281664 00000100:00100000:3.0:1790971800.978195:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745281664 00000100:00100000:3.0:1790971800.978259:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1790971800.978270:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2356:x1877969745281664:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971800.978288:0:8047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971800.978304:0:8047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a509 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790971800.978345:0:8047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790971800.978363:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1790971800.978368:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971800.978377:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 6 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.978393:0:8047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 6 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.978405:0:8047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ca00, rc 0) 00000100:00100000:3.0:1790971800.978465:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745281664:12345-192.168.203.43@tcp:101:bash.0 Request processed in 197us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971800.978505:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00080000:0.0:1790971800.978718:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971800.991413:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971800.992239:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745281792 00000100:00100000:3.0:1790971800.992256:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745281792 00000100:00100000:3.0:1790971800.992345:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1790971800.992366:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:11353:x1877969745281792:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971800.992398:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971800.992429:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a510 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.992527:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 7 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.992563:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971800.992569:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971800.992581:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.992725:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 7 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.992774:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 7 pid: 8047 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971800.992792:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1877969766257920:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971800.992909:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3840 going to sleep for 11 seconds 00000100:00100000:2.0:1790971800.996432:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971800.997876:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745281920 00000100:00100000:3.0:1790971800.997896:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745281920 00000100:00100000:0.0:1790971800.997902:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1877969766257920:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971800.997944:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971800.997977:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00010000:00010000:3.0:1790971800.998047:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 8 pid: 8047 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971800.998061:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:11353:x1877969745281792:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5701us (6660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971800.998088:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1790971800.998118:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1790971800.998135:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745281920:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971800.998157:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971800.998187:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 7 pid: 8047 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.998206:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 7 pid: 8047 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.998236:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a509 expref: 7 pid: 8047 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.998259:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971800.998265:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971800.998289:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.998300:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971800.998361:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971800.998379:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0329f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766258048:192.168.203.43@tcp:105: 00000100:00100000:3.0:1790971800.999888:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383240 going to sleep for 11 seconds 00000100:00100000:3.0:1790971801.015303:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0329f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766258048:192.168.203.43@tcp:105: 00010000:00010000:3.0:1790971801.015348:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971801.015441:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745281920:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 17309us (19023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971801.015454:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1790971801.020763:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971801.021017:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745282176 00000100:00100000:2.0:1790971801.021032:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745282176 00000100:00100000:2.0:1790971801.021177:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:2.0:1790971801.021190:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11353:x1877969745282176:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1790971801.022036:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11353:x1877969745282176:12345-192.168.203.43@tcp:35:bash.0 Request processed in 841us (1281us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1790971801.022048:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1790971801.132266:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971801.132435:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745282432 00000100:00100000:3.0:1790971801.132460:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745282432 00000100:00100000:3.0:1790971801.132583:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:3.0:1790971801.132595:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11363:x1877969745282432:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971801.132629:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971801.132658:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49f31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a517 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971801.132808:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790971801.132976:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49f31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a517 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.133000:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:3.0:1790971801.133003:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971801.133010:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49f31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a517 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.133028:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ca00, rc 0) 00000100:00100000:3.0:1790971801.133121:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11363:x1877969745282432:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 526us (878us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1790971801.133129:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:2.0:1790971801.141148:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971801.141266:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745282688 00000100:00100000:0.0:1790971801.141280:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745282688 00000100:00100000:0.0:1790971801.141364:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:0.0:1790971801.141376:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11363:x1877969745282688:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971801.141910:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11363:x1877969745282688:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 533us (775us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1790971801.141921:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1790971801.225573:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971801.225705:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745282816 00000100:00100000:1.0:1790971801.225718:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745282816 00000100:00100000:1.0:1790971801.225797:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:1.0:1790971801.225809:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11369:x1877969745282816:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971801.225844:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971801.225871:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49f3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a51e expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.225977:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49f46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.226014:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.226030:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971801.226074:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790971801.226079:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971801.226101:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.226134:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f49f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a51e expref: 23 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.226156:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a51e expref: 22 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.226165:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971801.226168:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971801.226172:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43600, rc 0) 00000100:00100000:1.0:1790971801.226255:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11369:x1877969745282816:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 448us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971801.226265:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:3.0:1790971801.230128:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971801.230263:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745283072 00000100:00100000:0.0:1790971801.230278:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745283072 00000100:00100000:0.0:1790971801.230354:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:0.0:1790971801.230367:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11369:x1877969745283072:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971801.230397:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971801.230426:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49f4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a525 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.230611:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.230629:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.230642:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971801.230656:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790971801.230830:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49f4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a525 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.230852:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a525 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.230881:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040400) 00010000:00010000:0.0:1790971801.230884:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971801.230888:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbc400, rc 0) 00000100:00100000:0.0:1790971801.230993:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11369:x1877969745283072:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 628us (880us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1790971801.231001:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:2.0:1790971801.248198:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971801.248543:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745283328 00000100:00100000:3.0:1790971801.248559:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745283328 00000100:00100000:3.0:1790971801.248642:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 146 00000100:00100000:3.0:1790971801.248654:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11369:x1877969745283328:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971801.248689:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971801.248724:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a52c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.248864:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.248883:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.248895:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971801.249719:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790971801.250137:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f49f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a52c expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.250167:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a52c expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.250177:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040400) 00010000:00010000:3.0:1790971801.250180:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790971801.250184:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d400, rc 0) 00000100:00100000:3.0:1790971801.250289:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11369:x1877969745283328:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1636us (2107us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1790971801.250298:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 146 00000100:00100000:2.0:1790971801.253843:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971801.255282:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745283456 00000100:00100000:1.0:1790971801.255302:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745283456 00000100:00100000:1.0:1790971801.255408:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1790971801.255419:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:2355:x1877969745283456:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971801.255440:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971801.255533:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a525 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.255559:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040400) 00010000:00010000:1.0:1790971801.255565:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971801.255653:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:2355:x1877969745283456:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 236us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971801.255663:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1790971801.267596:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971801.267700:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745283584 00000100:00100000:3.0:1790971801.267877:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745283584 00000100:00100000:3.0:1790971801.267973:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1790971801.267984:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745283584:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:3.0:1790971801.268043:0:8047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.268069:0:8047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.268078:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790971801.268082:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971801.268087:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.268147:0:8047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.268163:0:8047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 6 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971801.268181:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8047:1877969766258176:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971801.268309:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383300 going to sleep for 11 seconds 00000100:00100000:2.0:1790971801.279609:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971801.280175:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745283712 00000100:00100000:0.0:1790971801.280193:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745283712 00002000:00100000:0.0:1790971801.280282:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cd4b708ad80 x1877969745283712/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:72/0 lens 504/0 e 0 to 0 dl 1790971812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971801.280295:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b708ad80 with x1877969745283712 ext(0->12) 00010000:00010000:0.0:1790971801.280308:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 7 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.280329:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 7 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971801.280338:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4b708ad80 00000100:00100000:0.0:1790971801.280378:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1790971801.280389:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745283712:12345-192.168.203.43@tcp:4:lfs.0 00000100:00100000:3.0:1790971801.281257:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8047:1877969766258176:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971801.281294:0:8047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971801.282065:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745283712:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 1673us (2462us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790971801.282081:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00002000:00100000:0.0:1790971801.282096:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cd4b708ad80 x1877969745283712/t4294967305(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:72/0 lens 504/448 e 0 to 0 dl 1790971812 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971801.282119:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b708ad80 with x1877969745283712 ext(0->12) 00010000:00010000:0.0:1790971801.282131:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 9 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.282151:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 9 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971801.282160:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4b708ad80 00000100:00100000:2.0:1790971801.294198:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971801.294386:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745283840 00000100:00100000:1.0:1790971801.294404:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745283840 00010000:00010000:1.0:1790971801.294597:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 9 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971801.294653:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1790971801.294665:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2356:x1877969745283840:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971801.294696:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790971801.294728:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790971801.294732:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790971801 00002000:00010000:1.0:1790971801.294734:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790971801 00002000:00010000:1.0:1790971801.294736:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790971801 00010000:00010000:1.0:1790971801.294743:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 9 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.294768:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 9 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.294825:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f49f2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a510 expref: 9 pid: 6691 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.294846:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790971801.294851:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790971801.294859:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.294870:0:5826:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.294920:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971801.295116:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745283840:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 451us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971801.295127:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00010000:00010000:0.0:1790971801.295427:0:8047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295440:0:8047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295504:0:8047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295514:0:8047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295524:0:8047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295532:0:8047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971801.295537:0:8047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295558:0:8047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295572:0:8047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.295580:0:8047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f49f77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971801.295647:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745283584:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 27664us (28064us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971801.295656:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:1.0:1790971801.302675:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971801.303641:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745284096 00000100:00100000:2.0:1790971801.303653:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745284096 00000100:00100000:2.0:1790971801.303714:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:2.0:1790971801.303724:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483294450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11369:x1877969745284096:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:2.0:1790971801.303933:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a52c expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971801.304176:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1790971801.304534:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1790971801.305377:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1790971801.305440:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971801.305460:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971801.305489:0:5841:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971801.305538:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971801.305553:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 29 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971801.305568:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1877969766258304:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971801.305655:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971801.314364:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1877969766258304:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971801.314396:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971801.317223:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971801.317526:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745284224 00000100:00100000:0.0:1790971801.317537:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745284224 00010000:00010000:0.0:1790971801.317577:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 30 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971801.317612:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1790971801.317621:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+30:2357:x1877969745284224:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971801.317634:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971801.317640:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 30 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.317659:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 30 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.317680:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f49f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a502 expref: 30 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.317696:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040400) 00010000:00010000:0.0:1790971801.317701:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.317709:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.317717:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.317747:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971801.317805:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:2357:x1877969745284224:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 185us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971801.317813:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00010000:00010000:2.0:1790971801.318384:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971801.318395:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971801.318560:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1790971801.319267:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1790971801.319396:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766258432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790971801.319453:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971801.319625:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec000 going to sleep for 11 seconds 00000100:00100000:3.0:1790971801.324459:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766258432 00000100:00100000:3.0:1790971801.324559:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766258432 00000100:00100000:2.0:1790971801.330506:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790971801.330520:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766258432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790971801.330635:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766258432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (11181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971801.330642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790971801.330730:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766258432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790971801.331267:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1790971801.331348:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0297480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766258560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790971801.331390:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971801.331420:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1790971801.331670:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766258560 00000100:00100000:2.0:1790971801.331677:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766258560 00000100:00100000:2.0:1790971801.331704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790971801.331719:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877969766258560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790971801.331871:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1877969766258560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 153us (480us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790971801.331878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1790971801.333314:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971801.333436:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0297480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1877969766258560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790971801.333539:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1790971801.333608:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.333619:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.333626:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.333631:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971801.333636:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.333642:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.333655:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040400) 00010000:00010000:1.0:1790971801.333658:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790971801.333663:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.333668:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f49f7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790971801.334142:0:5841:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790971801.334363:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1790971801.334374:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380273903576ns, next at 381273901478ns, rc = 0 00000001:00080000:1.0:1790971801.334382:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1790971801.334421:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040400) 00010000:00010000:1.0:1790971801.334425:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790971801.334433:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49f69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a52c expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971801.334734:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483294450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:11369:x1877969745284096:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 31009us (32067us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1790971801.334744:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000020:00080000:1.0:1790971801.334760:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790971801.344003:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971801.344292:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745284352 00000100:00100000:0.0:1790971801.344302:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745284352 00000100:00100000:0.0:1790971801.344356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:0.0:1790971801.344366:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:11369:x1877969745284352:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971801.344390:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971801.344414:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a533 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.344818:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a533 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.344834:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a533 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.344854:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971801.344857:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971801.344861:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbcc00, rc 0) 00000100:00100000:0.0:1790971801.345036:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:11369:x1877969745284352:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 670us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971801.345044:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:3.0:1790971801.354419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971801.354878:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745284608 00000100:00100000:1.0:1790971801.354888:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745284608 00000100:00100000:2.0:1790971801.355191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:2.0:1790971801.355204:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+33:11369:x1877969745284608:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1790971801.355451:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:11369:x1877969745284608:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 249us (1039us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1790971801.355459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1790971801.445292:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790971801.445316:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766258688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971801.445388:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971801.445511:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766258688 00000100:00100000:2.0:1790971801.445520:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766258688 00000100:00100000:2.0:1790971801.445575:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790971801.445595:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4afd33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877969766258688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971801.445619:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971801.445686:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4afd33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1877969766258688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971801.445694:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790971801.445818:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766258688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971801.461457:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971801.461662:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745284864 00000100:00100000:3.0:1790971801.461676:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745284864 00000100:00100000:3.0:1790971801.461756:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:3.0:1790971801.461769:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:11379:x1877969745284864:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971801.461802:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971801.461829:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a53a expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971801.462004:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790971801.462156:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49f8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a53a expref: 36 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.462174:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:3.0:1790971801.462178:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971801.462183:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a53a expref: 36 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.462201:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d200, rc 0) 00000100:00100000:3.0:1790971801.462274:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:11379:x1877969745284864:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 508us (834us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1790971801.462282:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:3.0:1790971801.473391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971801.473534:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745284992 00000100:00100000:0.0:1790971801.473551:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745284992 00000100:00100000:0.0:1790971801.473634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:0.0:1790971801.473646:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:11379:x1877969745284992:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1790971801.473739:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.473757:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.473767:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.473781:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.473805:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474022:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474128:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474138:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474146:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971801.474187:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474198:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474204:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474211:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474216:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971801.474220:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474228:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474245:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971801.474248:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971801.474252:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474258:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474269:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474275:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474280:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474285:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbde00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971801.474288:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474299:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474305:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd487fd8e00) 00010000:00010000:0.0:1790971801.474307:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971801.474310:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474315:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474351:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474357:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474363:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474368:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971801.474371:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474377:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474384:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971801.474387:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971801.474389:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.474395:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971801.474520:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:11379:x1877969745284992:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 875us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971801.474529:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:2.0:1790971801.481799:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971801.481927:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745285248 00000100:00100000:1.0:1790971801.481942:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745285248 00000100:00100000:1.0:1790971801.482025:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1790971801.482035:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:11379:x1877969745285248:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971801.482337:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:11379:x1877969745285248:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 302us (553us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1790971801.482346:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1790971801.555707:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971801.555809:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745285504 00000100:00100000:3.0:1790971801.555819:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745285504 00000100:00100000:3.0:1790971801.555878:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:3.0:1790971801.555887:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:11382:x1877969745285504:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971801.555912:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971801.555933:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49faf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a541 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556176:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556192:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556215:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556231:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556239:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556245:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556361:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556370:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556377:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971801.556387:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790971801.556515:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556524:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556530:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556535:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971801.556545:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556553:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556564:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:3.0:1790971801.556567:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971801.556571:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556578:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f49fb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556590:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556596:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556601:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556606:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002cc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971801.556608:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556613:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556620:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd483040a00) 00010000:00010000:3.0:1790971801.556622:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971801.556630:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556636:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556678:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49faf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 39 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556692:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 38 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.556700:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:3.0:1790971801.556702:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971801.556704:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d400, rc 0) 00000100:00100000:3.0:1790971801.556986:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:11382:x1877969745285504:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 885us (1074us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1790971801.557061:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:1.0:1790971801.559780:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971801.560252:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745285632 00000100:00100000:0.0:1790971801.560262:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745285632 00000100:00100000:0.0:1790971801.561128:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 151 00000100:00100000:0.0:1790971801.561155:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:11382:x1877969745285632:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1790971801.561225:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561242:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561258:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561282:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561289:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561296:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561303:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971801.561307:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561314:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561324:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971801.561338:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790971801.561343:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971801.561349:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f49fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971801.561431:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:11382:x1877969745285632:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 280us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971801.561440:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 151 00000100:00100000:2.0:1790971801.568343:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971801.568433:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745285888 00000100:00100000:1.0:1790971801.568443:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745285888 00000100:00100000:1.0:1790971801.568513:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1790971801.568522:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:11382:x1877969745285888:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971801.568748:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:11382:x1877969745285888:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 227us (414us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790971801.568764:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00010000:00010000:2.0:1790971801.704977:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971801.926019:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971801.926142:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745286144 00000100:00100000:3.0:1790971801.926152:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745286144 00000100:00100000:3.0:1790971801.926214:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:3.0:1790971801.926224:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:11413:x1877969745286144:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1790971801.926251:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971801.926271:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49fd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a548 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.926369:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.926406:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.926417:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971801.926430:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790971801.926587:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f49fd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a548 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.926605:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a548 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971801.926613:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:3.0:1790971801.926616:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971801.926620:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002cc00, rc 0) 00000100:00100000:3.0:1790971801.926685:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:11413:x1877969745286144:12345-192.168.203.43@tcp:101:cat.0 Request processed in 462us (674us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1790971801.926692:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:3.0:1790971801.934754:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971801.934892:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971801.935669:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745286528 00000100:00100000:2.0:1790971801.935681:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745286528 00000100:00100000:2.0:1790971801.935748:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1790971801.935758:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:11413:x1877969745286528:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:2.0:1790971801.936016:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:11413:x1877969745286528:12345-192.168.203.43@tcp:35:cat.0 Request processed in 258us (1122us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1790971801.936035:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:1.0:1790971801.939859:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745286272 00000100:00100000:1.0:1790971801.939873:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745286272 00000100:00100000:1.0:1790971801.940011:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1790971801.940022:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:2356:x1877969745286272:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971801.940037:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971801.940064:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f49fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a548 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971801.940082:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:1.0:1790971801.940087:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971801.940156:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:2356:x1877969745286272:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 136us (5411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971801.940164:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1790971801.957193:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971801.957217:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766258816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971801.957290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971801.957401:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766258816 00000100:00100000:2.0:1790971801.957409:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766258816 00000100:00100000:2.0:1790971801.957466:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790971801.957501:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766258816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971801.957536:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971801.957578:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766258816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971801.957585:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1790971801.957649:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971801.957674:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1790971801.957680:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4be0df480, transno 4294967313 00000100:00100000:0.0:1790971801.957701:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766258816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971801.957883:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766259200:0@lo:400:kworker.0 00000100:00100000:1.0:1790971801.957909:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766259072:0@lo:400:kworker.0 00000100:00100000:1.0:1790971801.957958:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971801.957983:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971801.957989:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766258944:0@lo:400:kworker.0 00000100:00100000:1.0:1790971801.958017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971801.958059:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766259328:0@lo:400:kworker.0 00000100:00100000:3.0:1790971801.958063:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766258944 00000100:00100000:3.0:1790971801.958070:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766258944 00000100:00100000:3.0:1790971801.958102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790971801.958108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971801.958114:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766258944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971801.958152:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766259072 00000100:00100000:1.0:1790971801.958157:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766259072 00000100:00100000:3.0:1790971801.958163:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3303:x1877969766258944:12345-0@lo:400:kworker.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971801.958187:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766259328 00000100:00100000:3.0:1790971801.958189:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790971801.958199:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766259328 00000100:00100000:3.0:1790971801.958233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790971801.958276:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790971801.958296:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971801.958321:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0404db5-d37b-41bb-8054-1f8859117a4f:3303:1877969766258944:0@lo:400:kworker.0 00000100:00100000:0.0:1790971801.958343:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766259200 00000100:00100000:0.0:1790971801.958346:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766259200 00000100:00100000:3.0:1790971801.958382:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766259072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971801.958422:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766259072:12345-0@lo:400:kworker.0 Request processed in 181us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971801.961979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790971801.962006:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766259328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971801.962130:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766259328:12345-0@lo:400:kworker.0 Request processed in 138us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971801.962138:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790971801.962152:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790971801.962166:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766259200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971801.962206:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766259328:0@lo:400:kworker.0 00000100:00080000:1.0:1790971801.962252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971801.965252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790971801.966078:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766259200:12345-0@lo:400:kworker.0 Request processed in 3913us (7797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971801.966089:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790971801.966983:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766259072:0@lo:400:kworker.0 00000100:00100000:1.0:1790971801.967152:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766259200:0@lo:400:kworker.0 00000100:00100000:1.0:1790971802.027126:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971802.027230:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971802.027266:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971802.027301:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971802.027353:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745287040 00000100:00100000:2.0:1790971802.027363:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745287040 00000100:00100000:2.0:1790971802.027428:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:2.0:1790971802.027438:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745287040:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971802.027522:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2355:x1877969745287040:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971802.027531:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00080000:2.0:1790971802.027669:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971802.028205:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745286912 00000100:00100000:3.0:1790971802.028212:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745286912 00000100:00100000:3.0:1790971802.028987:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 298 00000100:00100000:3.0:1790971802.028997:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745286912:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971802.029058:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745286912:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 62us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971802.029065:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 298 00000100:00100000:0.0:1790971802.038484:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745286784 00000100:00100000:0.0:1790971802.038500:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745286784 00000100:00100000:0.0:1790971802.038578:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745287168 00000100:00100000:0.0:1790971802.038582:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745287168 00000100:00100000:0.0:1790971802.038635:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:0.0:1790971802.038645:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745287168:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971802.038730:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745287168:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 86us (11428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971802.038739:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:0.0:1790971802.038767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:0.0:1790971802.038775:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:11419:x1877969745286784:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:0.0:1790971802.038801:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971802.038805:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790971802.038830:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f49f46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a51e expref: 41 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.038851:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971802.038856:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790971802.038870:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a54f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.039223:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.039238:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 41 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.039259:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.039295:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 41 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.039320:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 41 pid: 7888 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971802.039334:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766259456:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971802.039391:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3600 going to sleep for 11 seconds 00000100:00080000:1.0:1790971802.040285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971802.041701:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766259456:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971802.041733:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971802.043512:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971802.043669:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745287296 00000100:00100000:0.0:1790971802.043679:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745287296 00010000:00010000:0.0:1790971802.043720:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 42 pid: 7888 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971802.043762:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1790971802.043772:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:2356:x1877969745287296:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971802.043798:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971802.043805:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 42 pid: 7888 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.043818:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 42 pid: 7888 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.043840:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f49fc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a541 expref: 42 pid: 7888 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.043874:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971802.043879:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.043889:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.043897:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.043935:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971802.044001:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:2356:x1877969745287296:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 231us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971802.044008:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00010000:00010000:1.0:1790971802.044289:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.044300:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971802.044317:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790971802.044467:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f49fee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.044515:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.044536:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:1.0:1790971802.044539:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790971802.044541:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd49bcbca00, rc 0) 00000100:00100000:1.0:1790971802.044582:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:11419:x1877969745286784:12345-192.168.203.43@tcp:101:dd.0 Request processed in 5808us (17465us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1790971802.044590:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:1.0:1790971802.050168:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971802.050251:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745287552 00000100:00100000:3.0:1790971802.050260:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745287552 00000100:00100000:3.0:1790971802.050311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 154 00000100:00100000:3.0:1790971802.050320:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+41:11419:x1877969745287552:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:3.0:1790971802.050604:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.050621:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.050632:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971802.050700:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1790971802.050724:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f3dd652b reply state 00000000ff7743be transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971802.050733:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971802.050840:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:11419:x1877969745287552:12345-192.168.203.43@tcp:36:dd.0 Request processed in 521us (680us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1790971802.050848:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 154 00000020:00080000:3.0:1790971802.050853:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790971802.053296:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.053313:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.053322:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.053329:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971802.053334:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.053342:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.053357:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:1.0:1790971802.053361:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971802.053365:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.053372:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a003 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971802.325053:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971802.325153:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745287680 00000100:00100000:0.0:1790971802.325162:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745287680 00000100:00100000:0.0:1790971802.325235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 155 00000100:00100000:0.0:1790971802.325245:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+43:11433:x1877969745287680:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:0.0:1790971802.325269:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971802.325290:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f4a00a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a556 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325353:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325367:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325380:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325409:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325418:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325426:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325550:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325561:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325569:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325601:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.325615:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 44 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971802.325628:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766259584:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971802.325720:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3180 going to sleep for 11 seconds 00000100:00100000:0.0:1790971802.329800:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766259584:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971802.329830:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971802.330577:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971802.330649:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745287936 00000100:00100000:2.0:1790971802.330657:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745287936 00000100:00100000:2.0:1790971802.330709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:2.0:1790971802.330727:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+45:5593:x1877969745287936:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790971802.331041:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:5593:x1877969745287936:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 315us (467us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1790971802.331050:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:2.0:1790971802.337637:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971802.337903:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745288064 00000100:00100000:3.0:1790971802.337914:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745288064 00010000:00010000:3.0:1790971802.337972:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 46 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971802.338015:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1790971802.338024:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:2356:x1877969745288064:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971802.338039:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971802.338046:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 46 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.338060:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 46 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.338083:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbca00/0xbd3388eaa6f49ff5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a54f expref: 46 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.338104:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:3.0:1790971802.338116:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.338125:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.338133:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.338167:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971802.338239:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+45:2356:x1877969745288064:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 216us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971802.338247:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00010000:00010000:0.0:1790971802.338672:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338681:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971802.338725:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790971802.338729:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971802.338763:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338776:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338796:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338803:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338810:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338815:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbc400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971802.338819:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338827:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338837:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971802.338852:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971802.338857:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338863:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbc400/0xbd3388eaa6f4a011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338875:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338881:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338887:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338892:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971802.338895:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338900:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338907:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd487fd8e00) 00010000:00010000:0.0:1790971802.338909:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971802.338912:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338916:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd000/0xbd3388eaa6f4a018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338967:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbde00/0xbd3388eaa6f4a00a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a556 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.338995:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a556 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.339002:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971802.339004:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971802.339006:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12f200, rc 0) 00000100:00100000:0.0:1790971802.339089:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:11433:x1877969745287680:12345-192.168.203.43@tcp:101:stat.0 Request processed in 13846us (14046us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971802.339096:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 155 00000100:00100000:2.0:1790971802.427629:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971802.427738:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745288320 00000100:00100000:3.0:1790971802.427758:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745288320 00000100:00100000:3.0:1790971802.427829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 156 00000100:00100000:3.0:1790971802.427842:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:11439:x1877969745288320:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:3.0:1790971802.427931:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971802.428110:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a01f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a556 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.428140:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:3.0:1790971802.428146:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971802.428450:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.428723:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.428736:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971802.428824:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1790971802.428853:0:5838:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000711d0cbf reply state 000000004c7bd7de transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971802.428863:0:5838:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971802.429156:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:11439:x1877969745288320:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 1312us (1537us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1790971802.429165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 156 00000020:00080000:3.0:1790971802.429172:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790971802.431692:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.431717:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.431725:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.431731:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971802.431738:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.431758:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.431777:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:3.0:1790971802.431780:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971802.431786:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.431792:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a026 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971802.620904:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971802.621109:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745288448 00000100:00100000:0.0:1790971802.621125:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745288448 00000100:00100000:0.0:1790971802.621207:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:0.0:1790971802.621220:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+45:11454:x1877969745288448:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:0.0:1790971802.621267:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971802.621295:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f000/0xbd3388eaa6f4a02d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a55d expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621385:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621404:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621418:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621435:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621462:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621506:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621614:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621624:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621631:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971802.621675:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790971802.621680:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971802.621706:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621719:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621728:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621736:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621743:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621762:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12fe00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971802.621767:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621775:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621790:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971802.621793:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971802.621799:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621806:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a034 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621823:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621829:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621835:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621839:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971802.621842:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621847:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621865:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd487fd8e00) 00010000:00010000:0.0:1790971802.621867:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971802.621870:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621875:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a03b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621914:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f000/0xbd3388eaa6f4a02d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 47 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621928:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 46 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.621935:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971802.621938:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971802.621957:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12e000, rc 0) 00000100:00100000:0.0:1790971802.622912:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:11454:x1877969745288448:12345-192.168.203.43@tcp:101:stat.0 Request processed in 1685us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971802.622925:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:2.0:1790971802.724370:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971802.724644:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745288704 00000100:00100000:3.0:1790971802.724658:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745288704 00000100:00100000:3.0:1790971802.724742:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 158 00000100:00100000:3.0:1790971802.724760:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+46:11464:x1877969745288704:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971802.724788:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971802.724814:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a564 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971802.724953:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790971802.725108:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a049 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a564 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.725124:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:3.0:1790971802.725128:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971802.725134:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a564 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.725164:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d800, rc 0) 00010000:00010000:2.0:1790971802.725667:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971802.725766:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:11464:x1877969745288704:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1005us (1410us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1790971802.725776:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 158 00000100:00100000:2.0:1790971802.730716:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971802.731021:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745288960 00000100:00100000:1.0:1790971802.731036:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745288960 00000100:00100000:1.0:1790971802.731216:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1790971802.731300:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483297050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+47:11464:x1877969745288960:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971802.731831:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483297050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:11464:x1877969745288960:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 601us (1127us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1790971802.731841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1790971802.799367:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971802.799679:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745289216 00000100:00100000:1.0:1790971802.799694:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745289216 00000100:00100000:1.0:1790971802.799781:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:1.0:1790971802.799793:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:11470:x1877969745289216:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1790971802.799829:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971802.799859:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a057 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a56b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.800014:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.800034:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 49 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.800044:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.800089:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 49 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.800124:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 49 pid: 7888 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971802.800153:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766259712:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971802.800281:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a07c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971802.805379:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766259712:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971802.805421:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971802.808358:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971802.808880:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745289344 00000100:00100000:1.0:1790971802.808908:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745289344 00010000:00010000:1.0:1790971802.808977:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 50 pid: 7888 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971802.809028:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:1.0:1790971802.809040:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+50:2357:x1877969745289344:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971802.809060:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971802.809067:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 50 pid: 7888 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.809082:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 50 pid: 7888 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.809109:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a55d expref: 50 pid: 7888 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.809163:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:1.0:1790971802.809170:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.809181:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.809191:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.809422:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971802.809653:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:2357:x1877969745289344:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 613us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971802.809663:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00010000:00010000:0.0:1790971802.810707:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.810724:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971802.810783:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1790971802.811016:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a057 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.811040:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.811049:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971802.811052:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790971802.811056:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42400, rc 0) 00000100:00100000:0.0:1790971802.811126:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:11470:x1877969745289216:12345-192.168.203.43@tcp:101:bash.0 Request processed in 11335us (11773us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1790971802.811420:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:0.0:1790971802.820350:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971802.820548:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745289600 00000100:00100000:2.0:1790971802.820561:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745289600 00000100:00100000:2.0:1790971802.820631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:2.0:1790971802.820641:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+49:11470:x1877969745289600:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:2.0:1790971802.821034:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971802.821059:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971802.821072:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971802.821127:0:5840:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1790971802.821163:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009cadaa18 reply state 000000001d8a9545 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971802.821172:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971802.821631:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:11470:x1877969745289600:12345-192.168.203.43@tcp:36:bash.0 Request processed in 987us (1292us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1790971802.821642:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 160 00000020:00080000:2.0:1790971802.821649:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790971802.825516:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.825541:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.825549:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.825556:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ec00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971802.825562:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.825571:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.825617:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:1.0:1790971802.825620:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971802.825626:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.825634:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a06c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971802.834158:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971802.834635:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745289728 00000100:00100000:2.0:1790971802.834651:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745289728 00000100:00100000:2.0:1790971802.834728:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:2.0:1790971802.834740:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:11470:x1877969745289728:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971802.834800:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971802.834829:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a073 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a572 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971802.834954:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971802.834971:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971802.834981:0:7888:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971802.835024:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971802.835040:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 52 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971802.835058:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766259840:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971802.835533:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feecd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790971802.841010:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971802.841091:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745289856 00000100:00100000:3.0:1790971802.841103:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745289856 00010000:00010000:3.0:1790971802.841165:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 53 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971802.841217:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1790971802.841257:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:2356:x1877969745289856:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971802.841278:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971802.841286:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 53 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.841302:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 53 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.841331:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:3.0:1790971802.841337:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.841349:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.841357:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971802.841379:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971802.841456:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:2356:x1877969745289856:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 195us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971802.841463:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00010000:00010000:0.0:1790971802.843716:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a05e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a56b expref: 52 pid: 5839 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971802.843969:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766259840:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971802.844320:0:7888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.844335:0:7888:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.844341:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971802.844430:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790971802.844435:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971802.844720:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.844786:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a073 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a572 expref: 52 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.844809:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a572 expref: 51 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.844820:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:0.0:1790971802.844823:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971802.844827:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5ee00, rc 0) 00000100:00100000:0.0:1790971802.844929:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:11470:x1877969745289728:12345-192.168.203.43@tcp:101:bash.0 Request processed in 10189us (10802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971802.844948:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:0.0:1790971802.849023:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971802.849152:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745290112 00000100:00100000:3.0:1790971802.849167:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745290112 00000100:00100000:3.0:1790971802.849249:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1790971802.849260:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:11470:x1877969745290112:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1790971802.849616:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:11470:x1877969745290112:12345-192.168.203.43@tcp:35:bash.0 Request processed in 356us (606us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1790971802.849656:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1790971802.949633:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971802.949989:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745290368 00000100:00100000:0.0:1790971802.950003:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745290368 00000100:00100000:0.0:1790971802.950126:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:0.0:1790971802.950147:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:11479:x1877969745290368:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971802.950181:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971802.950209:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a579 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971802.950511:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790971802.950695:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a081 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a579 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.950712:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:0.0:1790971802.950715:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790971802.950720:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a579 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971802.950735:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12ec00, rc 0) 00000100:00100000:0.0:1790971802.951046:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:11479:x1877969745290368:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 910us (1426us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1790971802.951056:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:1.0:1790971802.954484:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971802.954544:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745290496 00000100:00100000:1.0:1790971802.954558:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745290496 00000100:00100000:1.0:1790971802.954623:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:1.0:1790971802.954634:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:11479:x1877969745290496:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:1.0:1790971802.954913:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.954946:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.954960:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.954980:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.954988:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.954995:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955200:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955211:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955218:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790971802.955331:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955346:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955354:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955362:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955369:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971802.955374:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955383:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955396:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971802.955399:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971802.955404:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955417:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a08f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955432:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955438:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955444:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955449:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971802.955451:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955457:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955463:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd48dd1b600) 00010000:00010000:1.0:1790971802.955465:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971802.955468:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955508:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955529:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955535:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955546:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955551:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971802.955554:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955560:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955567:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:1.0:1790971802.955569:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971802.955572:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971802.955577:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a09d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971802.955671:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:11479:x1877969745290496:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1036us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971802.955681:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:2.0:1790971802.959256:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971802.959326:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745290752 00000100:00100000:3.0:1790971802.959339:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745290752 00000100:00100000:3.0:1790971802.959410:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1790971802.959421:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+53:11479:x1877969745290752:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971802.959780:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:11479:x1877969745290752:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 358us (539us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1790971802.959789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1790971803.012420:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971803.013349:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745291008 00000100:00100000:2.0:1790971803.013365:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745291008 00000100:00100000:2.0:1790971803.013439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:2.0:1790971803.013451:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:11483:x1877969745291008:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971803.013519:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971803.013546:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a0a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a580 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.013816:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.013836:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.013850:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.013867:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.013875:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.013882:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014347:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a0b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014358:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014366:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971803.014378:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790971803.014659:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014743:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014750:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014757:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971803.014763:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014772:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014786:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:2.0:1790971803.014789:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971803.014795:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014802:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a0ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014817:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014825:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014831:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014837:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971803.014846:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014854:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014863:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd4a656cc00) 00010000:00010000:2.0:1790971803.014866:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971803.014869:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.014875:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a0b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.015208:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a0a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a580 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.015224:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a580 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.015232:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:2.0:1790971803.015234:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971803.015237:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5ea00, rc 0) 00000100:00100000:2.0:1790971803.015326:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:11483:x1877969745291008:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1876us (2919us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1790971803.015336:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 164 00000001:00080000:0.0:1790971803.017362:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000004:00080000:0.0:1790971803.017403:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790971803.017429:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd482c78600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790971803.017435:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4b734a900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd482c78d80 00000020:00080000:0.0:1790971803.017438:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4b734a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4be2d2000 00000001:00080000:0.0:1790971803.017497:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000020:00080000:1.0:1790971803.017601:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1790971803.017799:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1790971803.018131:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971803.018158:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766259968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790971803.018252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971803.018401:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766259968 00000100:00100000:0.0:1790971803.018411:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766259968 00000100:00100000:0.0:1790971803.018510:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790971803.018524:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766259968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790971803.018558:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00000100:00080000:1.0:1790971803.018678:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1790971803.018767:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ac00f99, atime: 0x6ac00f99, ctime: 0x6ac00f99, blocks: 0x1 00010000:00010000:0.0:1790971803.018779:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971803.018820:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1790971803.018825:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971803.018833:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971803.018851:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971803.018861:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971803.018870:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971803.018947:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790971803.019310:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971803.019358:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971803.019388:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745291264 00000100:00100000:3.0:1790971803.019394:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745291264 00000100:00100000:3.0:1790971803.019456:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:3.0:1790971803.019464:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:2355:x1877969745291264:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971803.019500:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971803.019525:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a0b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a580 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971803.019547:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00000100:00100000:0.0:1790971803.019550:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1877969766259968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1031us (1297us total) trans 4294967307 rc 0/0 00010000:00010000:3.0:1790971803.019553:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971803.019558:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790971803.019593:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:2355:x1877969745291264:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 130us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971803.019600:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00010000:00010000:1.0:1790971803.019921:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971803.019931:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.019961:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971803.019966:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.019977:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.019993:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.020000:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a0c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.020022:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971803.020024:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971803.020025:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790971803.020139:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4be0df480/2, rc 0, transno 4294967307 00000100:00100000:1.0:1790971803.020147:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766259968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790971803.020339:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745291136 00000100:00100000:2.0:1790971803.020345:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745291136 00000100:00100000:2.0:1790971803.020393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:2.0:1790971803.020402:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:11483:x1877969745291136:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1790971803.020844:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020863:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020873:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020907:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020914:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020920:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020926:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971803.020929:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020947:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020957:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:2.0:1790971803.020961:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971803.020965:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.020971:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971803.021069:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:11483:x1877969745291136:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 667us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971803.021078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:3.0:1790971803.024745:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971803.024832:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745291520 00000100:00100000:2.0:1790971803.024846:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745291520 00000100:00100000:2.0:1790971803.024919:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:2.0:1790971803.024930:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:11483:x1877969745291520:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1790971803.025275:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11483:x1877969745291520:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 345us (556us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1790971803.025284:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:1.0:1790971803.148352:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971803.148528:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745291776 00000100:00100000:2.0:1790971803.148546:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745291776 00000100:00100000:2.0:1790971803.148633:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:2.0:1790971803.148645:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11501:x1877969745291776:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:2.0:1790971803.148679:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971803.148706:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a587 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.148834:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a0dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.148850:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a0dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.148865:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a0dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971803.148900:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790971803.149067:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a587 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.149100:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a0dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a587 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.149110:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:2.0:1790971803.149114:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790971803.149118:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fa00, rc 0) 00000100:00100000:2.0:1790971803.149197:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11501:x1877969745291776:12345-192.168.203.43@tcp:101:cat.0 Request processed in 555us (861us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790971803.149205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:0.0:1790971803.185082:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971803.185318:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745291904 00000100:00100000:1.0:1790971803.185331:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745291904 00000100:00100000:1.0:1790971803.185417:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:1.0:1790971803.185429:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11502:x1877969745291904:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971803.185462:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971803.185515:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a0ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a58e expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.185618:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a0f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.185635:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.185648:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971803.185854:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790971803.185859:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971803.185884:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.185915:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a0ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a58e expref: 22 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.185947:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a58e expref: 21 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971803.185957:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971803.185960:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971803.185965:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42400, rc 0) 00000100:00100000:1.0:1790971803.186114:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11502:x1877969745291904:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 687us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971803.186123:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:3.0:1790971803.190338:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971803.190467:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745292288 00000100:00100000:2.0:1790971803.190533:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745292288 00000100:00100000:2.0:1790971803.190604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:2.0:1790971803.190615:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11502:x1877969745292288:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1790971803.191624:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11502:x1877969745292288:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 1004us (1293us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1790971803.191634:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:0.0:1790971803.200913:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971803.201183:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745292416 00000100:00100000:3.0:1790971803.201196:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745292416 00000100:00100000:3.0:1790971803.201328:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1790971803.201340:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11502:x1877969745292416:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:3.0:1790971803.201365:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790971803.201403:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a07a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a572 expref: 22 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971803.201430:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a0dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a587 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971803.201444:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbcc00/0xbd3388eaa6f49f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a533 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971803.201456:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd487fd8100) 00010000:00010000:3.0:1790971803.201506:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971803.201584:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11502:x1877969745292416:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 246us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971803.201591:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1790971803.209704:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971803.215861:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745292544 00000100:00100000:3.0:1790971803.215884:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745292544 00000100:00100000:3.0:1790971803.215986:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:3.0:1790971803.215999:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11502:x1877969745292544:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:3.0:1790971803.216152:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971803.216175:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971803.216208:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790971803.216868:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790971803.217008:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11502:x1877969745292544:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 1008us (7535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971803.217020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:0.0:1790971803.235872:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971803.236075:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745292672 00000100:00100000:2.0:1790971803.236088:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745292672 00000100:00100000:2.0:1790971803.236165:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:2.0:1790971803.236176:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11504:x1877969745292672:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971803.236204:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971803.236248:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a595 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236333:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236350:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236362:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236379:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236386:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236393:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236949:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236961:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.236969:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971803.237013:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790971803.237019:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971803.237041:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237063:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237073:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237080:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237088:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237094:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971803.237099:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237108:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237121:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:2.0:1790971803.237125:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971803.237130:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237137:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a106 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237152:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237158:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237170:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237175:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971803.237178:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237184:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237192:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd4a656cc00) 00010000:00010000:2.0:1790971803.237195:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971803.237198:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237204:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a10d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237244:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a0ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237257:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971803.237265:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:2.0:1790971803.237268:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790971803.237270:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e600, rc 0) 00000100:00100000:2.0:1790971803.238018:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11504:x1877969745292672:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1837us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971803.238041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 169 00010000:00010000:0.0:1790971803.748637:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971804.071854:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971804.071866:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971804.072442:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790971804.072450:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790971804.073173:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0295f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766260096:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790971804.073371:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a060c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971804.089864:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0295f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766260096:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790971804.092906:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971804.106910:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745292800 00000100:00100000:0.0:1790971804.106947:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745292800 00000100:00100000:0.0:1790971804.107579:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:0.0:1790971804.107607:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11515:x1877969745292800:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790971804.107652:0:5840:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790971804.107801:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11515:x1877969745292800:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 199us (14913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971804.107811:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00080000:1.0:1790971804.110397:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971804.125652:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971804.126874:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745292928 00000100:00100000:1.0:1790971804.126893:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745292928 00000100:00100000:1.0:1790971804.126989:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:1.0:1790971804.127000:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11515:x1877969745292928:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790971804.127098:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127122:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127137:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127158:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127165:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127173:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127205:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127233:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127241:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971804.127288:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790971804.127293:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971804.127308:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127321:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127328:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127336:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127343:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.127348:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127356:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127370:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:1.0:1790971804.127374:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971804.127379:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127397:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a11b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127416:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127423:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127428:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127433:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.127437:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127444:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127452:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971804.127455:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971804.127457:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127464:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a122 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127518:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127525:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127537:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127543:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.127546:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127552:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127561:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971804.127564:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971804.127567:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.127573:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.127674:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11515:x1877969745292928:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 674us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971804.127684:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:1.0:1790971804.137583:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.137722:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745293184 00000100:00100000:3.0:1790971804.137736:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745293184 00000100:00100000:3.0:1790971804.137797:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:3.0:1790971804.137808:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11515:x1877969745293184:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971804.137837:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971804.137863:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a130 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a59c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138016:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138034:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138047:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971804.138060:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790971804.138177:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138186:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138200:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138206:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971804.138211:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138220:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138235:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:3.0:1790971804.138239:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971804.138244:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138251:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138301:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a130 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a59c expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138313:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:3.0:1790971804.138315:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971804.138320:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a130 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a59c expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.138329:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c800, rc 0) 00000100:00100000:3.0:1790971804.138408:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11515:x1877969745293184:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 601us (839us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1790971804.138431:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:2.0:1790971804.151722:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971804.151763:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745293312 00000100:00100000:1.0:1790971804.151776:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745293312 00000100:00100000:1.0:1790971804.151846:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:1.0:1790971804.151858:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11515:x1877969745293312:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790971804.151916:0:7888:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790971804.152067:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11515:x1877969745293312:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 211us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971804.152083:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:1.0:1790971804.159774:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.167515:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745293568 00000100:00100000:3.0:1790971804.167536:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745293568 00000100:00100000:3.0:1790971804.167627:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:3.0:1790971804.167638:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11515:x1877969745293568:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971804.167668:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971804.167672:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790971804.167705:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a0f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a58e expref: 21 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.167730:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:3.0:1790971804.167736:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971804.167753:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a145 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5a3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790971804.168906:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790971804.169923:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a14c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.171647:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a14c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.171664:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a14c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.171796:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a145 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5a3 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.171841:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a14c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5a3 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.171852:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040d00) 00010000:00010000:3.0:1790971804.171855:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971804.171859:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ca00, rc 0) 00000100:00100000:3.0:1790971804.173093:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11515:x1877969745293568:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 5445us (13321us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1790971804.173106:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:1.0:1790971804.194146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971804.194198:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745293824 00000100:00100000:1.0:1790971804.194209:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745293824 00000100:00100000:1.0:1790971804.194271:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:1.0:1790971804.194283:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11515:x1877969745293824:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790971804.194361:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971804.194397:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ca00/0xbd3388eaa6f4a14c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5a3 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194416:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040d00) 00010000:00010000:1.0:1790971804.194429:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971804.194459:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194491:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194502:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194518:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194525:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194532:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194790:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194799:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194806:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194813:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.194818:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194827:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194836:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971804.194839:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971804.194844:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194849:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a15a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194860:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194866:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194872:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194884:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.194887:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194893:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194901:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4a4910c0 (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971804.194904:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971804.194906:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.194912:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4a4910c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.195736:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11515:x1877969745293824:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1445us (1594us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790971804.195749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:2.0:1790971804.198753:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.198842:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745293952 00000100:00100000:3.0:1790971804.198855:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745293952 00000100:00100000:3.0:1790971804.198946:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 176 00000100:00100000:3.0:1790971804.198957:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11515:x1877969745293952:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971804.198986:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971804.199018:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a168 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.199064:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.199080:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.199094:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.199213:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.199242:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.199253:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:3.0:1790971804.199256:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790971804.199260:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00000100:00100000:3.0:1790971804.199337:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11515:x1877969745293952:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 382us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971804.199345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 176 00000040:00080000:0.0:1790971804.202138:0:12458:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790971804.202149:0:12458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790971804.202191:0:12458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790971804.202200:0:12458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790971804.204965:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971804.207103:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745294208 00000100:00100000:2.0:1790971804.207122:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745294208 00000100:00100000:2.0:1790971804.207208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 177 00000100:00100000:2.0:1790971804.207221:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11515:x1877969745294208:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790971804.207337:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.207360:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.207374:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790971804.208346:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1790971804.208360:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383147889350ns, next at 384147886336ns, rc = 0 00000004:00010000:2.0:1790971804.208455:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000befc422e reply state 00000000b0857b2a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971804.209630:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971804.209994:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11515:x1877969745294208:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 2767us (5032us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1790971804.210007:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 177 00010000:00010000:3.0:1790971804.217981:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.218006:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.218016:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.218024:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971804.218031:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.218040:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.218064:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:3.0:1790971804.218068:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790971804.218105:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.218113:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a176 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971804.218410:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.219282:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745294336 00000100:00100000:3.0:1790971804.219297:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745294336 00000100:00100000:3.0:1790971804.219410:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 178 00000100:00100000:3.0:1790971804.219423:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:11515:x1877969745294336:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971804.219453:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971804.219500:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.219577:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.219594:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.219617:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:3.0:1790971804.219620:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790971804.219624:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c800, rc 0) 00000100:00100000:3.0:1790971804.219701:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11515:x1877969745294336:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 280us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971804.219708:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 178 00000100:00100000:0.0:1790971804.232972:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971804.233063:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745294464 00000100:00100000:2.0:1790971804.233078:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745294464 00000100:00100000:2.0:1790971804.233174:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1790971804.233184:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745294464:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790971804.233850:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745294464:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 663us (965us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790971804.233859:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00080000:3.0:1790971804.236003:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971804.236290:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971804.243159:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745294720 00000100:00100000:0.0:1790971804.243182:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745294720 00000100:00100000:0.0:1790971804.243273:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1790971804.243284:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11515:x1877969745294720:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790971804.243637:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11515:x1877969745294720:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 353us (7352us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1790971804.243646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:2.0:1790971804.249611:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971804.249715:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745294976 00000100:00100000:0.0:1790971804.249738:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745294976 00000100:00100000:0.0:1790971804.249813:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 179 00000100:00100000:0.0:1790971804.249824:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11515:x1877969745294976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790971804.249983:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11515:x1877969745294976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 161us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971804.249991:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 179 00000100:00100000:1.0:1790971804.260997:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971804.261075:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745295104 00000100:00100000:2.0:1790971804.261099:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745295104 00000100:00100000:2.0:1790971804.261173:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 180 00000100:00100000:2.0:1790971804.261185:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11515:x1877969745295104:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971804.261212:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971804.261238:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5b8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.261329:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a18b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.261347:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.261360:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971804.261407:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971804.261432:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.261462:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b8 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.261544:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b8 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.261553:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:2.0:1790971804.261557:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790971804.261560:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5ee00, rc 0) 00000100:00100000:2.0:1790971804.261634:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11515:x1877969745295104:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 451us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971804.261642:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 180 00000100:00100000:2.0:1790971804.268205:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.268585:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745295232 00000100:00100000:3.0:1790971804.268601:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745295232 00000100:00100000:3.0:1790971804.268698:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1790971804.268709:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2355:x1877969745295232:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971804.268746:0:8047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971804.268776:0:8047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5bf expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790971804.268811:0:8047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ac00f9c, blocks: 0x1 00010000:00010000:3.0:1790971804.268837:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1790971804.268842:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971804.268854:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 8 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.268877:0:8047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 8 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.268981:0:8047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d200, rc 0) 00000100:00100000:3.0:1790971804.269063:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2355:x1877969745295232:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 355us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971804.269070:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:2.0:1790971804.283529:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971804.283995:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745295488 00000100:00100000:0.0:1790971804.284009:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745295488 00000100:00100000:0.0:1790971804.284078:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:0.0:1790971804.284088:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11515:x1877969745295488:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790971804.284465:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11515:x1877969745295488:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 376us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971804.284498:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:1.0:1790971804.293265:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.293518:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745295616 00000100:00100000:3.0:1790971804.293532:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745295616 00000100:00100000:3.0:1790971804.293593:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1790971804.293605:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:11515:x1877969745295616:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971804.293631:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971804.293655:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5c6 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.293708:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 9 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.293719:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971804.293724:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971804.293743:0:6689:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.293785:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 9 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.293800:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 9 pid: 8047 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971804.293817:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495771880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1877969766260224:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971804.293950:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383900 going to sleep for 11 seconds 00000100:00100000:3.0:1790971804.296509:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495771880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1877969766260224:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971804.296561:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.296585:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d400, rc 0) 00000100:00100000:3.0:1790971804.296649:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:11515:x1877969745295616:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 3046us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971804.296658:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1790971804.296993:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.297025:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745295744 00000100:00100000:3.0:1790971804.297035:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745295744 00010000:00010000:3.0:1790971804.297071:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 9 pid: 8047 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971804.297104:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1790971804.297113:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2356:x1877969745295744:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971804.297129:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971804.297158:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 9 pid: 8047 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.297171:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 9 pid: 8047 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.297199:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048babb8c/0xbd3388eaa6f4a192 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5bf expref: 9 pid: 8047 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.297212:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971804.297216:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971804.297226:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.297236:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.297291:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971804.297309:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1877969766260352:192.168.203.43@tcp:105: 00000100:00100000:3.0:1790971804.297374:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383900 going to sleep for 11 seconds 00000100:00100000:3.0:1790971804.301995:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1877969766260352:192.168.203.43@tcp:105: 00010000:00010000:3.0:1790971804.302034:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971804.302115:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745295744:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 5001us (5121us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971804.302128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1790971804.304367:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.304567:0:6694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745295872 00000100:00100000:3.0:1790971804.304581:0:6694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745295872 00002000:00100000:3.0:1790971804.304655:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cd4c032c000 x1877969745295872/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:75/0 lens 504/0 e 0 to 0 dl 1790971815 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790971804.304667:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4c032c000 with x1877969745295872 ext(0->8) 00002000:00010000:3.0:1790971804.304676:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4c032c000 00000100:00100000:3.0:1790971804.304706:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1790971804.304717:0:6694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745295872:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790971804.309133:0:6694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:2356:x1877969745295872:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 4399us (4758us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790971804.309153:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00002000:00100000:3.0:1790971804.309172:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cd4c032c000 x1877969745295872/t4294967315(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:75/0 lens 504/448 e 0 to 0 dl 1790971815 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790971804.309202:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4c032c000 with x1877969745295872 ext(0->8) 00002000:00010000:3.0:1790971804.309210:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4c032c000 00000100:00100000:1.0:1790971804.314310:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971804.314357:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745296000 00000100:00100000:2.0:1790971804.314371:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745296000 00000100:00100000:2.0:1790971804.314456:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:2.0:1790971804.314493:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11515:x1877969745296000:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1790971804.427645:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11515:x1877969745296000:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 113162us (113329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971804.427663:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:3.0:1790971804.431755:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.431806:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745296128 00000100:00100000:3.0:1790971804.431819:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745296128 00000100:00100000:3.0:1790971804.431888:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1790971804.431901:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:2357:x1877969745296128:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1790971804.433549:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1790971804.433580:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:1.0:1790971804.433599:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1790971804.433642:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1790971804.433653:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790971804.436060:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766260480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790971804.436176:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971804.437422:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766260480 00000100:00100000:2.0:1790971804.437436:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766260480 00000100:00100000:2.0:1790971804.437535:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790971804.437547:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766260480:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1790971804.437971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1790971804.438524:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790971804.438530:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790971804 00002000:00010000:2.0:1790971804.438533:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790971804.438536:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790971804 -> 1790971804 00002000:00010000:2.0:1790971804.438538:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790971804.438638:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766260480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1090us (2459us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790971804.438658:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:1.0:1790971804.448587:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4bd8a2d80/2, rc 0, transno 4294967316 00000100:00100000:1.0:1790971804.448608:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bd8a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766260480:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1790971804.512257:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1790971804.512284:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1790971804.512564:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745296128:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 80656us (80825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971804.512582:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1790971804.517065:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971804.517375:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745296384 00000100:00100000:0.0:1790971804.517390:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745296384 00000100:00100000:0.0:1790971804.517501:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:0.0:1790971804.517512:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11515:x1877969745296384:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790971804.517582:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971804.517619:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a18b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.517643:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:0.0:1790971804.517648:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790971804.517690:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.517707:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.517718:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971804.518146:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe13fb13 reply state 00000000cace64af transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971804.518182:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971804.518314:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11515:x1877969745296384:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 802us (1262us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790971804.518324:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 183 00010000:00010000:2.0:1790971804.519508:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.519526:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.519535:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.519542:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ee00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971804.519548:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.519557:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.519574:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:2.0:1790971804.519578:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971804.519584:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.519591:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ee00/0xbd3388eaa6f4a1a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971804.520435:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971804.520974:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745296512 00000100:00100000:0.0:1790971804.520988:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745296512 00000100:00100000:0.0:1790971804.521108:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1790971804.521122:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745296512:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790971804.521405:0:8047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790971804.521410:0:8047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790971804 -> 1790971802 00002000:00010000:0.0:1790971804.521413:0:8047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790971801 00002000:00010000:0.0:1790971804.521416:0:8047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790971804 -> 1790971802 00002000:00010000:0.0:1790971804.521418:0:8047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790971804.521680:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745296512:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 558us (1253us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790971804.521689:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:3.0:1790971804.526950:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971804.527072:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745296768 00000100:00100000:1.0:1790971804.527087:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745296768 00000100:00100000:1.0:1790971804.527175:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:1.0:1790971804.527188:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11515:x1877969745296768:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790971804.527287:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.527308:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.527318:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.527365:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.527381:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 18 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.527399:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766260608:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971804.527548:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971804.535766:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766260608:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971804.535809:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971804.541242:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971804.541549:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745296896 00000100:00100000:1.0:1790971804.541563:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745296896 00010000:00010000:1.0:1790971804.541622:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 19 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.541666:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1790971804.541690:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:2356:x1877969745296896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971804.541709:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971804.541717:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 19 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.541733:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 19 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.541760:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5aa expref: 19 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.541781:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:1.0:1790971804.541787:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.541799:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.541808:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.541854:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971804.541953:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.541956:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:2356:x1877969745296896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 268us (728us total) trans 0 rc 0/0 00010000:00010000:2.0:1790971804.541966:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.541989:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00010000:00010000:2.0:1790971804.542020:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.542030:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.542038:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.542045:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971804.542050:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.542059:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.542069:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:2.0:1790971804.542072:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790971804.542077:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.542083:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a1a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971804.542135:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:11515:x1877969745296768:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 14949us (15215us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790971804.542146:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:1.0:1790971804.544649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971804.544808:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745297024 00000100:00100000:2.0:1790971804.544822:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745297024 00000100:00100000:2.0:1790971804.544888:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1790971804.544916:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2354:x1877969745297024:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790971804.546779:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.546826:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.546837:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971804.546842:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971804.546847:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.546901:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.546920:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 8 pid: 6689 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971804.547008:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766260736:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971804.547135:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec780 going to sleep for 11 seconds 00000100:00100000:2.0:1790971804.552966:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766260736:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971804.553008:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.558270:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971804.558443:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745297152 00000100:00100000:3.0:1790971804.558458:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745297152 00010000:00010000:3.0:1790971804.558558:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 9 pid: 6689 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971804.558608:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:3.0:1790971804.558619:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745297152:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971804.558657:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971804.558817:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 9 pid: 6689 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.558834:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 9 pid: 6689 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.558864:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6395099/0xbd3388eaa6f4a199 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5c6 expref: 9 pid: 6689 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.558885:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971804.558890:0:7634:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971804.558897:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.558909:0:7634:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971804.558961:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971804.559037:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745297152:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 418us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971804.559046:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00010000:00010000:2.0:1790971804.559144:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559164:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559194:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559204:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559213:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559220:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fe00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971804.559225:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559235:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559249:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.559257:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfd3198c/0xbd3388eaa6f4a1ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971804.559323:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2354:x1877969745297024:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 14409us (14687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971804.559332:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1790971804.573389:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971804.574066:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745297408 00000100:00100000:1.0:1790971804.574081:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745297408 00000100:00100000:1.0:1790971804.574169:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:1.0:1790971804.574182:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd386c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+17:11515:x1877969745297408:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790971804.574289:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.574314:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.574328:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.574659:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.574684:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.574695:0:7888:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.574740:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.574757:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 18 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.574792:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766260864:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971804.574918:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971804.579556:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971804.581432:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745297536 00000100:00100000:2.0:1790971804.581451:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745297536 00010000:00010000:2.0:1790971804.581557:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 19 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971804.581612:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1790971804.581624:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:2356:x1877969745297536:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971804.581645:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971804.581653:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 19 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.581679:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 19 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.581707:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:2.0:1790971804.581713:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.581724:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.581733:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.581782:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971804.581862:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:2356:x1877969745297536:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 240us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971804.581870:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00010000:00010000:0.0:1790971804.584448:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a17d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5b1 expref: 18 pid: 5838 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971804.584495:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766260864:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971804.584529:0:7888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.584541:0:7888:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.584568:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790971804.584804:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1790971804.584998:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1790971804.585049:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1790971804.585170:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766260992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790971804.585255:0:7888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971804.585298:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a734c600 going to sleep for 11 seconds 00000100:00100000:2.0:1790971804.587591:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766260992 00000100:00100000:2.0:1790971804.587612:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766260992 00000100:00100000:2.0:1790971804.587704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971804.587716:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7888:x1877969766260992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790971804.587892:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7888:x1877969766260992:12345-0@lo:1000:mdt00_003.0 Request processed in 166us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971804.587902:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790971804.588198:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766260992:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1790971804.594998:0:7888:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1790971804.595975:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766261120:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790971804.596075:0:7888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971804.596196:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe90e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971804.598742:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766261120 00000100:00100000:2.0:1790971804.598762:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766261120 00000100:00100000:2.0:1790971804.598909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971804.598921:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7888:x1877969766261120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790971804.599324:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7888:x1877969766261120:12345-0@lo:1000:mdt00_003.0 Request processed in 405us (3248us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790971804.599333:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790971804.599447:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7888:1877969766261120:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1790971804.599523:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599536:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599545:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599553:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.599559:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599568:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599587:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd483040400) 00010000:00010000:1.0:1790971804.599590:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790971804.599596:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599626:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a1bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599681:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599688:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599694:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599700:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.599703:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599710:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599719:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971804.599722:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790971804.599725:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599731:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a0f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599757:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599774:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599792:0:7888:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599835:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.599853:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.599870:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd49f362680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766261248:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971804.599983:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe90e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971804.603271:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971804.603353:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd49f362680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766261248:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971804.603386:0:7888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.603788:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745297664 00000100:00100000:1.0:1790971804.603797:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745297664 00010000:00010000:1.0:1790971804.603840:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 22 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.603883:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:1.0:1790971804.603894:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:2356:x1877969745297664:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971804.603913:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971804.603920:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 22 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.603967:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 22 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.603994:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a595 expref: 22 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604013:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971804.604018:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604028:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604038:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604064:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971804.604137:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:2356:x1877969745297664:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 244us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971804.604145:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00010000:00010000:1.0:1790971804.604378:0:7888:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604387:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604403:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604423:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604431:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604438:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.604443:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604451:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604461:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971804.604464:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971804.604491:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604499:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604513:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604519:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604525:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604531:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971804.604540:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604547:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604555:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040a00) 00010000:00010000:1.0:1790971804.604557:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790971804.604560:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971804.604566:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a1b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971804.607169:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd386c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11515:x1877969745297408:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 32908us (33712us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1790971804.607188:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 185 00000020:00080000:1.0:1790971804.607197:0:7888:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790971804.612566:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790971804.612578:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790971804.614618:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1790971804.614643:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790971804.619345:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971804.623276:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745297920 00000100:00100000:0.0:1790971804.623301:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745297920 00000100:00100000:0.0:1790971804.623412:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1790971804.623425:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483294050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11515:x1877969745297920:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790971804.625643:0:5841:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790971804.627038:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1790971804.627253:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.627277:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.627292:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.627302:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.627310:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.627325:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971804.627421:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790971804.627606:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483294050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11515:x1877969745297920:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 4173us (8265us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1790971804.627620:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000020:00080000:0.0:1790971804.627627:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790971804.632051:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971804.632069:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.632083:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971804.632088:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.632246:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.632291:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cd487fd8800) 00010000:00010000:2.0:1790971804.632294:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790971804.632300:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.632307:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e000/0xbd3388eaa6f4a1ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971804.632345:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971804.632347:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971804.632349:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971804.772815:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790971805.619447:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1790971805.619487:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:3.0:1790971805.803163:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971806.113637:0:12511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971806.113653:0:12511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971806.113699:0:12511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790971806.113707:0:12511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790971806.247387:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.247543:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745298176 00000100:00100000:3.0:1790971806.247558:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745298176 00000100:00100000:3.0:1790971806.247661:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 186 00000100:00100000:3.0:1790971806.247675:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:11533:x1877969745298176:12345-192.168.203.43@tcp:101:lfs.0 00000100:00080000:0.0:1790971806.247682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790971806.247713:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971806.247845:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a1d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5cd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.247987:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f400/0xbd3388eaa6f4a1d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.248005:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f400/0xbd3388eaa6f4a1d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.248021:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f400/0xbd3388eaa6f4a1d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971806.248035:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790971806.248197:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a1d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5cd expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.248221:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f400/0xbd3388eaa6f4a1d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5cd expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.248265:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971806.248269:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790971806.248273:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12f400, rc 0) 00000100:00100000:0.0:1790971806.248360:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11533:x1877969745298176:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 689us (988us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1790971806.248368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 186 00000100:00100000:3.0:1790971806.257193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.257244:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745298304 00000100:00100000:3.0:1790971806.257257:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745298304 00000100:00100000:3.0:1790971806.257325:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:3.0:1790971806.257336:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11533:x1877969745298304:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1790971806.257441:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.257514:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.257528:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.257546:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.257552:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.257559:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258075:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258096:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258104:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971806.258154:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258168:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258176:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258183:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258190:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.258194:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258203:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258216:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:3.0:1790971806.258219:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971806.258224:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258230:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a1e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258249:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258255:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258261:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258266:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.258269:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258274:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258280:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd483040100) 00010000:00010000:3.0:1790971806.258283:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971806.258285:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258290:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a1ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258305:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258312:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258318:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258329:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002cc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.258332:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258338:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258345:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd483040500) 00010000:00010000:3.0:1790971806.258348:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971806.258351:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.258357:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002cc00/0xbd3388eaa6f4a1f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971806.258491:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11533:x1877969745298304:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1129us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971806.258501:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:3.0:1790971806.302387:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971806.304857:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745298560 00000100:00100000:1.0:1790971806.304876:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745298560 00000100:00100000:1.0:1790971806.304985:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:1.0:1790971806.304997:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11536:x1877969745298560:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971806.305027:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971806.305054:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.305172:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.305191:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.305203:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.305220:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.305238:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.305246:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307492:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307515:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307536:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971806.307552:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790971806.307674:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307683:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307700:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307707:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971806.307713:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307723:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307739:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971806.307742:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971806.307748:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307756:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43200/0xbd3388eaa6f4a202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307774:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307781:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307787:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.307791:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971806.307794:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.308123:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.308133:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd48dd1b600) 00010000:00010000:1.0:1790971806.308136:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971806.308140:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.308146:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43c00/0xbd3388eaa6f4a209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.308344:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4a1fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.308367:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.308375:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:3.0:1790971806.308378:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971806.308380:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42800, rc 0) 00000100:00100000:3.0:1790971806.308500:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11536:x1877969745298560:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 3503us (6125us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790971806.308510:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:0.0:1790971806.312645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971806.312764:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745298688 00000100:00100000:1.0:1790971806.312777:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745298688 00000100:00100000:1.0:1790971806.312863:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:1.0:1790971806.312874:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11536:x1877969745298688:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1790971806.312986:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313009:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313022:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313057:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313065:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313091:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313098:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971806.313103:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313112:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313125:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971806.313129:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790971806.313134:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.313141:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a21e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971806.313626:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11536:x1877969745298688:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 750us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971806.313638:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:1.0:1790971806.317513:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.318266:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745298944 00000100:00100000:3.0:1790971806.318281:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745298944 00000100:00100000:3.0:1790971806.318366:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1790971806.318377:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11536:x1877969745298944:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971806.318736:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:11536:x1877969745298944:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 358us (1237us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790971806.318745:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1790971806.362423:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971806.362632:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745299200 00000100:00100000:0.0:1790971806.362646:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745299200 00000100:00100000:0.0:1790971806.362709:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:0.0:1790971806.362720:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:11061:x1877969745299200:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971806.362752:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971806.362779:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a225 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5db expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.362940:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.362957:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.362968:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.363012:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.363052:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 28 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971806.363070:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766261376:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971806.363190:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971806.370660:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0329880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766261376:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971806.370679:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:3.0:1790971806.370703:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971806.370715:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745299328 00000100:00100000:1.0:1790971806.370722:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745299328 00010000:00010000:1.0:1790971806.370768:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 29 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971806.370879:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:1.0:1790971806.370900:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:2356:x1877969745299328:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971806.370927:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971806.370935:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 29 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.370949:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 29 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.370975:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5d4 expref: 29 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.370993:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971806.370997:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.371008:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.371018:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.371044:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971806.371047:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.371054:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971806.371076:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:1.0:1790971806.371106:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:2356:x1877969745299328:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 208us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971806.371115:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00010000:00010000:3.0:1790971806.371452:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f200/0xbd3388eaa6f4a225 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.371504:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.371514:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:3.0:1790971806.371526:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790971806.371530:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12ea00, rc 0) 00000100:00100000:3.0:1790971806.371573:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:11061:x1877969745299200:12345-192.168.203.43@tcp:101:bash.0 Request processed in 8855us (9166us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1790971806.371581:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:1.0:1790971806.388767:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971806.388839:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745299584 00000100:00100000:1.0:1790971806.388853:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745299584 00000100:00100000:1.0:1790971806.388933:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 191 00000100:00100000:1.0:1790971806.388977:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:11061:x1877969745299584:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:1.0:1790971806.395992:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.396027:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.396044:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790971806.396211:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1790971806.396274:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086d67636 reply state 00000000345a2898 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971806.396286:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790971806.399304:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1790971806.399682:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:11061:x1877969745299584:12345-192.168.203.43@tcp:36:bash.0 Request processed in 10700us (10922us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1790971806.399695:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 191 00000020:00080000:1.0:1790971806.399702:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1790971806.407713:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.407738:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.407748:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.407754:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971806.407760:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.407778:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.407798:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971806.407815:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971806.407822:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.407829:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a23a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971806.412047:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971806.412193:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745299712 00000100:00100000:2.0:1790971806.412207:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745299712 00000100:00100000:2.0:1790971806.412290:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:2.0:1790971806.412302:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:11061:x1877969745299712:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971806.412508:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971806.412536:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a241 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.412618:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.412634:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.412656:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:2.0:1790971806.412658:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971806.412663:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fe00, rc 0) 00000100:00100000:2.0:1790971806.412742:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b708b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:11061:x1877969745299712:12345-192.168.203.43@tcp:101:bash.0 Request processed in 441us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971806.412750:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:3.0:1790971806.421375:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.421424:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745299840 00000100:00100000:3.0:1790971806.421437:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745299840 00000100:00100000:3.0:1790971806.421524:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1790971806.421536:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:11061:x1877969745299840:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971806.421560:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971806.421587:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5e9 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790971806.421620:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ac00f9a, atime: 0x6ac00f99, ctime: 0x6ac00f9a, blocks: 0xb 00010000:00010000:3.0:1790971806.421649:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1790971806.421654:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971806.421664:0:6689:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.421685:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.421699:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002cc00, rc 0) 00000100:00100000:3.0:1790971806.421778:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:11061:x1877969745299840:12345-192.168.203.43@tcp:101:bash.0 Request processed in 244us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971806.421799:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00080000:0.0:1790971806.422524:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971806.428611:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971806.428670:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745299968 00000100:00100000:0.0:1790971806.428683:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745299968 00002000:00010000:0.0:1790971806.428741:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1790971806.428747:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b7088a80 with x1877969745299968 ext(0->18446744073709551615) 00002000:00010000:0.0:1790971806.428761:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4b7088a80. 00000100:00100000:0.0:1790971806.428790:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1790971806.428800:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b7088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745299968:12345-192.168.203.43@tcp:10:bash.0 00002000:00010000:0.0:1790971806.429166:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790971806.429171:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790971802 -> 1790971806 00002000:00010000:0.0:1790971806.429174:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790971801 -> 1790971801 00002000:00010000:0.0:1790971806.429176:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790971802 -> 1790971806 00002000:00010000:0.0:1790971806.429179:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790971806.429264:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b7088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745299968:12345-192.168.203.43@tcp:10:bash.0 Request processed in 464us (662us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1790971806.429273:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00002000:00010000:0.0:1790971806.429277:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1790971806.429280:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4b7088a80 with x1877969745299968 ext(0->18446744073709551615) 00002000:00010000:0.0:1790971806.429284:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4b7088a80. 00000100:00100000:1.0:1790971806.545308:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.545413:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745300096 00000100:00100000:3.0:1790971806.545426:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745300096 00000100:00100000:3.0:1790971806.545514:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:3.0:1790971806.545525:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:11550:x1877969745300096:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1790971806.545620:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.545643:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.545657:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.545674:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.545682:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.545689:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.545983:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.545993:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546001:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971806.546068:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546081:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546089:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546097:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546105:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.546110:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546117:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546130:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:3.0:1790971806.546133:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971806.546139:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546146:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a24f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546159:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546166:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546180:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546185:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.546189:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546196:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546205:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd483040700) 00010000:00010000:3.0:1790971806.546207:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971806.546210:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546216:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546234:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546241:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546247:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546252:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.546255:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546272:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546280:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:3.0:1790971806.546283:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971806.546286:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.546293:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a25d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971806.546396:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:11550:x1877969745300096:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 871us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971806.546405:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:1.0:1790971806.564886:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766261504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971806.564998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971806.566079:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766261504 00000100:00100000:2.0:1790971806.566093:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766261504 00000100:00100000:2.0:1790971806.566187:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790971806.566199:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766261504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971806.566249:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971806.566332:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766261504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971806.566340:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790971806.566399:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1790971806.566406:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1790971806.566433:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4be0df480, transno 4294967307 00000100:00100000:2.0:1790971806.566458:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766261504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790971806.570239:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790971806.594254:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971806.594680:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745300352 00000100:00100000:1.0:1790971806.594694:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745300352 00000100:00100000:1.0:1790971806.594784:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1790971806.594796:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+32:11553:x1877969745300352:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971806.594829:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971806.594857:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a264 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5f0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.594968:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.594989:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.595021:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.595040:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.595048:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.595055:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.595397:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.595408:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.595416:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971806.595427:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790971806.599848:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599873:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599883:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599890:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971806.599895:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599904:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599933:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971806.599937:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971806.599943:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599950:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a26b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599969:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599976:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.599982:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.600011:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971806.600014:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.600020:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.600028:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd48dd1b600) 00010000:00010000:0.0:1790971806.600031:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971806.600034:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.600040:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.600342:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a264 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5f0 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.600363:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5f0 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.600371:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:0.0:1790971806.600374:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790971806.600377:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934600, rc 0) 00000100:00100000:0.0:1790971806.600590:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:11553:x1877969745300352:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 5794us (6349us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1790971806.600602:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:0.0:1790971806.608360:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.609431:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745300480 00000100:00100000:3.0:1790971806.609446:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745300480 00000100:00100000:3.0:1790971806.609575:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:3.0:1790971806.609586:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:11553:x1877969745300480:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1790971806.609682:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.609705:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.609725:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.609770:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.609804:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 34 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971806.609823:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766261632:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971806.609958:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383900 going to sleep for 11 seconds 00000100:00100000:3.0:1790971806.620012:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c02cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766261632:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971806.620055:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971806.625038:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971806.625362:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745300736 00000100:00100000:1.0:1790971806.625376:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745300736 00000100:00100000:1.0:1790971806.625445:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1790971806.625457:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:5594:x1877969745300736:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790971806.626235:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:5594:x1877969745300736:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 772us (1204us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1790971806.626246:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1790971806.629269:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971806.629375:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745300864 00000100:00100000:0.0:1790971806.629387:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745300864 00010000:00010000:0.0:1790971806.629443:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 36 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971806.629618:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:0.0:1790971806.629630:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:2357:x1877969745300864:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971806.629654:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971806.629662:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 36 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.629676:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 36 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.629702:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a22c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5db expref: 36 pid: 5840 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.629997:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:0.0:1790971806.630005:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.630017:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.630026:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.630099:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971806.630189:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:2357:x1877969745300864:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 560us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971806.630198:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00010000:00010000:3.0:1790971806.632321:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632342:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632385:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632394:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632402:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632409:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.632415:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632423:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632496:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:3.0:1790971806.632499:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971806.632505:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.632512:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971806.632631:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:11553:x1877969745300480:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 23040us (24280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971806.632643:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:3.0:1790971806.637835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971806.637938:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745301120 00000100:00100000:0.0:1790971806.637952:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745301120 00000100:00100000:0.0:1790971806.638029:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1790971806.638040:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+34:11553:x1877969745301120:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1790971806.638386:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:11553:x1877969745301120:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 346us (565us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1790971806.638395:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:2.0:1790971806.752227:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.752421:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745301376 00000100:00100000:3.0:1790971806.752434:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745301376 00000100:00100000:3.0:1790971806.752537:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:3.0:1790971806.752547:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+35:11564:x1877969745301376:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1790971806.752578:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971806.752604:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a28e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5f7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.752690:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.752707:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.752727:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.752763:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.752771:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.752778:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.753089:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a2a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.753098:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.753105:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971806.753115:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1790971806.754669:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754689:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754698:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754705:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971806.754778:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754807:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754824:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:2.0:1790971806.754827:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971806.754833:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754840:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754860:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754937:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754943:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754948:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971806.754951:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754957:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754965:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd483040700) 00010000:00010000:2.0:1790971806.754968:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971806.754971:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.754990:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a29c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.755063:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a28e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5f7 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.755079:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5f7 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.755087:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:2.0:1790971806.755089:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971806.755093:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c800, rc 0) 00000100:00100000:2.0:1790971806.758396:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:11564:x1877969745301376:12345-192.168.203.43@tcp:101:cat.0 Request processed in 5832us (6163us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1790971806.758422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:2.0:1790971806.764541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971806.765023:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745301632 00000100:00100000:0.0:1790971806.765039:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745301632 00000100:00100000:0.0:1790971806.765173:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:0.0:1790971806.765185:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:11564:x1877969745301632:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:0.0:1790971806.765570:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:11564:x1877969745301632:12345-192.168.203.43@tcp:35:cat.0 Request processed in 385us (1042us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1790971806.765579:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:1.0:1790971806.784667:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971806.788440:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745301888 00000100:00100000:2.0:1790971806.788466:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745301888 00000100:00100000:2.0:1790971806.788614:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 197 00000100:00100000:2.0:1790971806.788628:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:11565:x1877969745301888:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:2.0:1790971806.788709:0:7888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790971806.788744:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a2a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5f7 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.788772:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5f0 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.788815:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a241 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e2 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.788826:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd48dd1bb00) 00010000:00010000:2.0:1790971806.788839:0:7888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971806.789173:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789191:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789202:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789222:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789229:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789236:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789777:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789789:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.789798:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790971806.790725:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1790971806.790740:0:7888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385730268394ns, next at 386730264937ns, rc = 0 00010000:00010000:2.0:1790971806.791724:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795587:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795630:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795645:0:7888:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795652:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795660:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795763:0:7888:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971806.795808:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795824:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795831:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795838:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971806.795873:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795883:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795899:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd4a656cc00) 00010000:00010000:2.0:1790971806.795903:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790971806.795917:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795924:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a2bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795955:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795961:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795967:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795973:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971806.795975:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795980:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.795988:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:2.0:1790971806.795990:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971806.795998:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.796004:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a2b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790971806.796015:0:7888:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000538ba6b1 reply state 00000000213b5211 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971806.796025:0:7888:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971806.796277:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+37:11565:x1877969745301888:12345-192.168.203.43@tcp:36:rm.0 Request processed in 7643us (11618us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790971806.796290:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 197 00010000:00010000:3.0:1790971806.797581:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971806.797597:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.797610:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971806.797614:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.797624:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.797642:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cd4a656cc00) 00010000:00010000:3.0:1790971806.797660:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790971806.797666:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.797673:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a2c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.797701:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971806.797703:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971806.797705:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971806.801170:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.801199:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.801208:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.801216:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fa00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971806.801223:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.801232:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.801257:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd4a656c300) 00010000:00010000:2.0:1790971806.801260:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971806.801267:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.801297:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a2b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971806.825432:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971806.841059:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971806.841521:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745302144 00000100:00100000:0.0:1790971806.841534:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745302144 00000100:00100000:0.0:1790971806.841610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:0.0:1790971806.841621:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+36:11571:x1877969745302144:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971806.841653:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971806.841682:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a2cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a5fe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.841837:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.841881:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.841895:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.841924:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.841932:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.841939:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790971806.842631:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1790971806.842832:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842844:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842854:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842897:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842904:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842926:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842941:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971806.842946:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842955:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842971:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971806.842974:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971806.842980:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.842987:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a2d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971806.843004:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a53384b1 reply state 00000000b0c35114 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971806.843013:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790971806.843051:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a2cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.843067:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971806.843074:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:0.0:1790971806.843076:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971806.843079:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12e400, rc 0) 00000100:00100000:0.0:1790971806.843168:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:11571:x1877969745302144:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1547us (2123us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790971806.843183:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 198 00010000:00010000:3.0:1790971806.847337:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.847361:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.847371:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.847378:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ec00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971806.847383:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.847393:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.847413:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd487fd8500) 00010000:00010000:3.0:1790971806.847417:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971806.847421:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.847428:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a2db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971806.853072:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.853318:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745302272 00000100:00100000:3.0:1790971806.853333:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745302272 00000100:00100000:3.0:1790971806.853430:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:3.0:1790971806.853441:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745302272:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971806.853503:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971806.853531:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a605 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790971806.853563:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790971806.853587:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1790971806.853592:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971806.853603:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.853625:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.853641:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00000100:00100000:3.0:1790971806.853708:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2357:x1877969745302272:12345-192.168.203.43@tcp:101:bash.0 Request processed in 269us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971806.853715:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00080000:1.0:1790971806.854424:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971806.860601:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.860816:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745302400 00000100:00100000:3.0:1790971806.860832:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745302400 00000100:00100000:3.0:1790971806.860931:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1790971806.860942:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:11571:x1877969745302400:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971806.860988:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971806.861016:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a60c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.861055:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.861065:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971806.861070:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971806.861076:0:6689:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.861119:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.861135:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 7 pid: 6690 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971806.861151:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1877969766261760:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971806.861267:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383900 going to sleep for 11 seconds 00000100:00100000:0.0:1790971806.864925:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971806.865017:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745302528 00000100:00100000:2.0:1790971806.865030:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745302528 00010000:00010000:2.0:1790971806.865087:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 8 pid: 6690 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971806.865131:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:2.0:1790971806.865141:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745302528:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971806.865161:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971806.865192:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 8 pid: 6690 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.865209:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 8 pid: 6690 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.865241:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971806.865246:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971806.865257:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.865268:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971806.865312:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971806.865350:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495a6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766261888:192.168.203.43@tcp:105: 00000100:00100000:2.0:1790971806.865496:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feeccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1790971806.868459:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a2f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a605 expref: 8 pid: 6690 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971806.868508:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1877969766261760:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971806.868553:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971806.868591:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ca00, rc 0) 00000100:00100000:3.0:1790971806.869348:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:11571:x1877969745302400:12345-192.168.203.43@tcp:101:bash.0 Request processed in 8401us (8755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971806.869359:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1790971806.873042:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495a6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1877969766261888:192.168.203.43@tcp:105: 00010000:00010000:3.0:1790971806.873082:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971806.873219:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971806.873356:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745302528:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 8214us (8455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971806.873369:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:2.0:1790971806.874705:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745302784 00000100:00100000:2.0:1790971806.874732:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745302784 00000100:00100000:2.0:1790971806.874811:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1790971806.874822:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+38:11571:x1877969745302784:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1790971806.879547:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:11571:x1877969745302784:12345-192.168.203.43@tcp:35:bash.0 Request processed in 4710us (6313us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790971806.879565:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:1.0:1790971807.007129:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.007230:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745302912 00000100:00100000:3.0:1790971807.007243:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745302912 00000100:00100000:3.0:1790971807.007323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 199 00000100:00100000:3.0:1790971807.007334:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+39:11587:x1877969745302912:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971807.007374:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971807.007405:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a2fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a613 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.007662:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.007679:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.007692:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971807.007951:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790971807.007956:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971807.007981:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.008010:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4a2fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a613 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.008034:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a613 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.008044:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:3.0:1790971807.008047:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971807.008051:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c800, rc 0) 00000100:00100000:3.0:1790971807.008181:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+40:11587:x1877969745302912:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 848us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971807.008189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 199 00000100:00100000:2.0:1790971807.018362:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.018610:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745303168 00000100:00100000:0.0:1790971807.018623:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745303168 00000100:00100000:0.0:1790971807.018697:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:0.0:1790971807.018925:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+40:11587:x1877969745303168:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971807.018953:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971807.018979:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e600/0xbd3388eaa6f4a30c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a61a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.019105:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fc00/0xbd3388eaa6f4a313 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.019122:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fc00/0xbd3388eaa6f4a313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.019135:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fc00/0xbd3388eaa6f4a313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971807.019148:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790971807.019313:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e600/0xbd3388eaa6f4a30c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a61a expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.019336:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fc00/0xbd3388eaa6f4a313 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a61a expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.019345:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:0.0:1790971807.019348:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971807.019369:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12fc00, rc 0) 00000100:00100000:0.0:1790971807.019632:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:11587:x1877969745303168:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 711us (1283us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1790971807.019641:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:0.0:1790971807.024444:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.026005:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745303296 00000100:00100000:3.0:1790971807.026024:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745303296 00000100:00100000:3.0:1790971807.026339:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1790971807.026352:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:2357:x1877969745303296:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971807.026379:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971807.026412:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fc00/0xbd3388eaa6f4a313 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a61a expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.026434:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:3.0:1790971807.026438:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:3.0:1790971807.026461:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971807.026577:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745303552 00000100:00100000:1.0:1790971807.026583:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745303552 00000100:00100000:1.0:1790971807.026618:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:1.0:1790971807.026626:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+42:11587:x1877969745303552:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971807.026654:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.026679:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a621 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.026811:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a328 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.026840:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.026852:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971807.026873:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790971807.027039:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a621 expref: 45 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.027072:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a328 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a621 expref: 44 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.027081:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:1.0:1790971807.027084:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790971807.027086:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494935c00, rc 0) 00000100:00100000:1.0:1790971807.027161:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+44:11587:x1877969745303552:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 535us (726us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790971807.027169:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:2.0:1790971807.027584:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+43:2357:x1877969745303296:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1233us (3154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.027593:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1790971807.039145:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.039236:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745303680 00000100:00100000:3.0:1790971807.039250:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745303680 00000100:00100000:3.0:1790971807.039334:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1790971807.039346:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+6:2356:x1877969745303680:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:3.0:1790971807.039407:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.039443:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.039453:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971807.039459:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971807.039466:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.039951:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.039969:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 6 pid: 6689 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971807.039988:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1877969766262016:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971807.040126:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383900 going to sleep for 11 seconds 00000100:00100000:3.0:1790971807.048571:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1877969766262016:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971807.048615:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971807.057163:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.057517:0:6694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745303808 00000100:00100000:3.0:1790971807.057533:0:6694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745303808 00002000:00100000:3.0:1790971807.057604:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cd4bddf7b80 x1877969745303808/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:78/0 lens 504/0 e 0 to 0 dl 1790971818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790971807.057617:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bddf7b80 with x1877969745303808 ext(0->8) 00010000:00010000:3.0:1790971807.057628:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 7 pid: 6689 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.057648:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 7 pid: 6689 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790971807.057657:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4bddf7b80 00000100:00100000:3.0:1790971807.057699:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:3.0:1790971807.057722:0:6694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745303808:12345-192.168.203.43@tcp:4:lfs.0 00000100:00100000:3.0:1790971807.061818:0:6694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745303808:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 4090us (4659us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790971807.061840:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00002000:00100000:3.0:1790971807.061861:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cd4bddf7b80 x1877969745303808/t4294967308(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:78/0 lens 504/448 e 0 to 0 dl 1790971818 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790971807.061873:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bddf7b80 with x1877969745303808 ext(0->8) 00010000:00010000:3.0:1790971807.061886:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 9 pid: 6689 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.061950:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 9 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790971807.061960:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cd4bddf7b80 00000100:00100000:0.0:1790971807.066318:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.068522:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745303936 00000100:00100000:1.0:1790971807.068543:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745303936 00010000:00010000:1.0:1790971807.068603:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 9 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.068663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:1.0:1790971807.068675:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745303936:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971807.068695:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790971807.068723:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790971807.068726:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790971806 00002000:00010000:1.0:1790971807.068728:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790971807 00002000:00010000:1.0:1790971807.068731:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790971806 00010000:00010000:1.0:1790971807.068739:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 9 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.068755:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 9 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.068827:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a1c949/0xbd3388eaa6f4a2f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a60c expref: 9 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.068846:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1790971807.068850:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790971807.068857:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.068869:0:5826:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.068917:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971807.068999:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745303936:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 325us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.069007:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00010000:00010000:2.0:1790971807.069116:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069128:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069159:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069169:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069186:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069194:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971807.069199:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069209:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069221:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.069266:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c8638c/0xbd3388eaa6f4a336 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.069322:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745303680:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 29978us (30193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.069330:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:2.0:1790971807.076279:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.076637:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790971807.076663:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766262272:0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.076685:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766262400:0@lo:400:kworker.0 00000100:00100000:2.0:1790971807.076761:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766262784:0@lo:400:kworker.0 00000100:00100000:3.0:1790971807.078424:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745304192 00000100:00100000:3.0:1790971807.078443:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745304192 00000100:00100000:3.0:1790971807.078544:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1790971807.078557:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483296450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+43:11587:x1877969745304192:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:3.0:1790971807.078643:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a328 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a621 expref: 43 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971807.081336:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1790971807.081399:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1790971807.081801:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1790971807.082618:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.082649:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.082660:0:5842:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.082714:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.082735:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 47 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971807.082771:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1877969766263040:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971807.082950:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971807.083008:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c03e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766262912:0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083039:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971807.083069:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790971807.083076:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766262528:0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083115:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971807.083172:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766262912 00000100:00100000:1.0:1790971807.083182:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766262912 00000100:00100000:1.0:1790971807.083251:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790971807.083272:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1877969766262912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083335:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1877969766262912:12345-0@lo:400:kworker.0 Request processed in 64us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.083343:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1790971807.083368:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971807.083408:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766262912:0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083443:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766262400 00000100:00100000:1.0:1790971807.083446:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766262400 00000100:00100000:1.0:1790971807.083492:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766262528 00000100:00100000:1.0:1790971807.083496:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766262528 00000100:00100000:1.0:1790971807.083521:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790971807.083528:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766262400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083566:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c03e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766262400:12345-0@lo:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.083573:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790971807.083585:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790971807.083591:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766262528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083627:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766262528:12345-0@lo:400:kworker.0 Request processed in 36us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971807.083630:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971807.083633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1790971807.083646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971807.083662:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766262528:0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083673:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766262400:0@lo:400:kworker.0 00000100:00100000:0.0:1790971807.083677:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766262144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971807.083706:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971807.083741:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd487d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766262656:0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083744:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766262272 00000100:00100000:1.0:1790971807.083747:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766262272 00000100:00100000:0.0:1790971807.083765:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971807.083773:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1790971807.083786:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766262272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.083824:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766262272:12345-0@lo:400:kworker.0 Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.083830:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790971807.083841:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766262272:0@lo:400:kworker.0 00000100:00100000:2.0:1790971807.084156:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971807.084201:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766262656 00000100:00100000:2.0:1790971807.084205:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766262656 00000100:00100000:2.0:1790971807.084245:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790971807.084261:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766262656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971807.084300:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766262656:12345-0@lo:400:kworker.0 Request processed in 40us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.084307:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790971807.084333:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766262144 00000100:00100000:2.0:1790971807.084336:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766262144 00000100:00100000:2.0:1790971807.084358:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790971807.084364:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766262144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971807.084395:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971807.084430:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766262144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.084437:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790971807.085591:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766262784 00000100:00100000:1.0:1790971807.085601:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766262784 00000100:00100000:1.0:1790971807.085664:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790971807.085674:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766262784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971807.085755:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766262784:12345-0@lo:400:kworker.0 Request processed in 83us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.085763:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1790971807.086585:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971807.086638:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c03e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766262784:0@lo:400:kworker.0 00000100:00100000:0.0:1790971807.086801:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd487d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766262656:0@lo:400:kworker.0 00000100:00100000:0.0:1790971807.086839:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766262144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971807.087194:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383900 going to sleep for 11 seconds 00000100:00100000:0.0:1790971807.095146:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.095377:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745304320 00000100:00100000:1.0:1790971807.095391:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745304320 00010000:00010000:1.0:1790971807.095443:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 48 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.095534:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:1.0:1790971807.095546:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:2357:x1877969745304320:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971807.095566:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971807.095574:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 48 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.095592:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 48 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.095621:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:1.0:1790971807.095628:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.095659:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.095668:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.095695:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971807.095774:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+48:2357:x1877969745304320:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 230us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.095784:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00010000:00010000:2.0:1790971807.095986:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e400/0xbd3388eaa6f4a2e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5fe expref: 47 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.096007:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1877969766263040:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971807.096038:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.096049:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.096054:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971807.096218:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1790971807.096530:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1790971807.096680:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1877969766263168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790971807.096745:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971807.096905:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971807.099995:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766263168 00000100:00100000:1.0:1790971807.100017:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766263168 00000100:00100000:1.0:1790971807.100107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790971807.100120:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1877969766263168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790971807.100562:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1877969766263168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 443us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.100572:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790971807.100739:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1877969766263168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790971807.109421:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1790971807.109609:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1877969766263296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790971807.109704:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971807.109746:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feece40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971807.109974:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766263296 00000100:00100000:0.0:1790971807.109984:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766263296 00000100:00100000:0.0:1790971807.110058:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790971807.110070:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1877969766263296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790971807.110364:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49f362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1877969766263296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 295us (659us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790971807.110388:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790971807.110459:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1877969766263296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790971807.110555:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1790971807.110604:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.110616:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.110626:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.110633:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971807.110638:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.110648:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.110668:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:2.0:1790971807.110671:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790971807.110683:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.110691:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a33d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790971807.111096:0:5842:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790971807.111271:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1790971807.111288:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386050817210ns, next at 387050814035ns, rc = 0 00000001:00080000:2.0:1790971807.111297:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1790971807.111338:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd487fd8a00) 00010000:00010000:2.0:1790971807.111342:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790971807.111352:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a328 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a621 expref: 51 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.112090:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483296450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+50:11587:x1877969745304192:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 33529us (35820us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1790971807.112102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000020:00080000:2.0:1790971807.112108:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790971807.118043:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.118129:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745304448 00000100:00100000:1.0:1790971807.118142:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745304448 00000100:00100000:1.0:1790971807.118267:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:1.0:1790971807.118279:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+50:11587:x1877969745304448:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971807.118315:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.118345:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a344 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a628 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.118683:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a628 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.118733:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a628 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.118759:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971807.118762:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790971807.118767:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494935200, rc 0) 00000100:00100000:1.0:1790971807.118850:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:11587:x1877969745304448:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 573us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.118859:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:0.0:1790971807.125360:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.125579:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745304704 00000100:00100000:1.0:1790971807.125591:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745304704 00000100:00100000:1.0:1790971807.125660:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1790971807.125671:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+51:11587:x1877969745304704:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971807.126222:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:11587:x1877969745304704:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 549us (871us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790971807.126231:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1790971807.148223:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.148279:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.148305:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.148347:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.148413:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745305088 00000100:00100000:1.0:1790971807.148426:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745305088 00000100:00100000:1.0:1790971807.148533:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745304960 00000100:00100000:1.0:1790971807.148537:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745304960 00000100:00100000:1.0:1790971807.148561:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:1.0:1790971807.148571:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2354:x1877969745305088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971807.148667:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2354:x1877969745305088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 96us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.148676:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:1.0:1790971807.148723:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1790971807.148729:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2354:x1877969745304960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971807.148758:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2354:x1877969745304960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.148764:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1790971807.148788:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745305216 00000100:00100000:1.0:1790971807.148792:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745305216 00000100:00100000:1.0:1790971807.148836:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:1.0:1790971807.148843:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745305216:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971807.148884:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745305216:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.148892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00080000:1.0:1790971807.148919:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971807.149644:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745304832 00000100:00100000:3.0:1790971807.149655:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745304832 00000100:00100000:3.0:1790971807.149703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 300 00000100:00100000:3.0:1790971807.149711:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745304832:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971807.149757:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745304832:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 47us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971807.149764:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 300 00000100:00100000:1.0:1790971807.198139:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.198250:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745305344 00000100:00100000:0.0:1790971807.198264:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745305344 00000100:00100000:0.0:1790971807.198343:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:0.0:1790971807.198354:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:11597:x1877969745305344:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1790971807.198511:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198551:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198570:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198577:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198589:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198705:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198715:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198744:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971807.198801:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198816:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198822:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198830:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198837:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971807.198842:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198850:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198877:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971807.198881:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971807.198887:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198893:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a34b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198917:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198929:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198934:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198939:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971807.198942:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198948:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198956:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd487fd8300) 00010000:00010000:0.0:1790971807.198959:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971807.198961:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198968:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f600/0xbd3388eaa6f4a352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198987:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.198994:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.199001:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.199007:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971807.199015:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.199021:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.199029:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971807.199031:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971807.199034:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.199039:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971807.199127:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:11597:x1877969745305344:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 773us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971807.199137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:0.0:1790971807.240723:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.240887:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745305600 00000100:00100000:1.0:1790971807.240901:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745305600 00000100:00100000:1.0:1790971807.240994:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:1.0:1790971807.241006:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+52:11600:x1877969745305600:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971807.241034:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.241062:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a360 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a62f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241166:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241185:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241221:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241239:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241248:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241255:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241411:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241421:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241428:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971807.241440:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790971807.241629:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241638:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241645:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241652:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971807.241664:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241673:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241687:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971807.241690:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971807.241698:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241705:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a367 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241721:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241727:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241732:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241737:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971807.241740:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241744:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241752:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971807.241754:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971807.241763:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241769:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a36e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241818:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a360 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241833:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.241840:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971807.241842:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790971807.241844:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934200, rc 0) 00000100:00100000:1.0:1790971807.241941:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:11600:x1877969745305600:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 937us (1242us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1790971807.241950:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:2.0:1790971807.246003:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.246112:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745305728 00000100:00100000:0.0:1790971807.246126:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745305728 00000100:00100000:0.0:1790971807.246204:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:0.0:1790971807.246215:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:11600:x1877969745305728:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1790971807.246307:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246329:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246343:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246408:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246416:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246423:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246430:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971807.246435:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246445:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246459:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971807.246462:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790971807.246467:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.246516:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971807.246607:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:11600:x1877969745305728:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 393us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971807.246615:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:3.0:1790971807.251638:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.251766:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745305984 00000100:00100000:2.0:1790971807.251779:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745305984 00000100:00100000:2.0:1790971807.251850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1790971807.251861:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+54:11600:x1877969745305984:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1790971807.252326:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:11600:x1877969745305984:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 464us (702us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1790971807.252355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1790971807.324097:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.324237:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745306240 00000100:00100000:1.0:1790971807.324252:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745306240 00000100:00100000:1.0:1790971807.324329:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:1.0:1790971807.324341:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:11610:x1877969745306240:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1790971807.324375:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.324378:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790971807.324413:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c800/0xbd3388eaa6f4a305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a613 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.324437:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971807.324443:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790971807.324567:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a38a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a636 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.324694:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.324710:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.324719:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.324757:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.324784:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 55 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.324800:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766263424:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971807.324922:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971807.329381:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.329959:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766263424:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971807.329998:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.330187:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745306368 00000100:00100000:2.0:1790971807.330197:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745306368 00010000:00010000:2.0:1790971807.330248:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 56 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.330334:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:2.0:1790971807.330344:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+56:2356:x1877969745306368:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971807.330365:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971807.330372:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 56 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.330385:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 56 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.330420:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a62f expref: 56 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.330440:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971807.330445:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.330457:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.330546:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.330603:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971807.330670:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:2356:x1877969745306368:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 326us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.330678:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00010000:00010000:3.0:1790971807.330856:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.330875:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971807.330912:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790971807.331111:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a38a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.331130:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.331138:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:3.0:1790971807.331141:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790971807.331154:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934c00, rc 0) 00000100:00100000:3.0:1790971807.331187:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:11610:x1877969745306240:12345-192.168.203.43@tcp:101:bash.0 Request processed in 6849us (7105us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1790971807.331196:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:3.0:1790971807.334032:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.334193:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745306624 00000100:00100000:0.0:1790971807.334210:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745306624 00000100:00100000:0.0:1790971807.334332:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:0.0:1790971807.334362:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+55:11610:x1877969745306624:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:0.0:1790971807.334771:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.334794:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.334808:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790971807.334870:0:5839:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1790971807.334896:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000097bf6e06 reply state 00000000afb3affc transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971807.335005:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971807.335115:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+58:11610:x1877969745306624:12345-192.168.203.43@tcp:36:bash.0 Request processed in 754us (1096us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1790971807.335123:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 207 00000020:00080000:0.0:1790971807.335129:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790971807.337189:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.337209:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.337217:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.337223:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971807.337229:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.337238:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.337257:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971807.337260:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971807.337265:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.337271:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ea00/0xbd3388eaa6f4a39f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971807.339843:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.340149:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745306752 00000100:00100000:2.0:1790971807.340163:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745306752 00000100:00100000:2.0:1790971807.340293:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 208 00000100:00100000:2.0:1790971807.340304:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+57:11610:x1877969745306752:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971807.340340:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971807.340368:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a3a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a63d expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.340533:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.340550:0:7888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.340560:0:7888:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.340607:0:7888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.340624:0:7888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 58 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.340641:0:7888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766263552:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971807.340766:0:7888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971807.343699:0:7888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7888:1877969766263552:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971807.343742:0:7888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971807.346757:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.346992:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745306880 00000100:00100000:2.0:1790971807.347025:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745306880 00010000:00010000:2.0:1790971807.347081:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 59 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.347139:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:2.0:1790971807.347154:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:2356:x1877969745306880:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971807.347175:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971807.347183:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 59 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.347199:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 59 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.347228:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a391 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a636 expref: 59 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.347317:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971807.347324:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.347335:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.347344:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.347427:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971807.347683:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+58:2356:x1877969745306880:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 533us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.347704:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00010000:00010000:3.0:1790971807.347770:0:7888:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.347779:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971807.347853:0:7888:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790971807.347859:0:7888:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971807.347885:0:7888:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.347933:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a3a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 58 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.347951:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 57 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.347959:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:3.0:1790971807.347962:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971807.347965:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e000, rc 0) 00000100:00100000:3.0:1790971807.348007:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+57:11610:x1877969745306752:12345-192.168.203.43@tcp:101:bash.0 Request processed in 7706us (8180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971807.348015:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 208 00000100:00100000:3.0:1790971807.351178:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.352072:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745307136 00000100:00100000:1.0:1790971807.352087:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745307136 00000100:00100000:1.0:1790971807.352197:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1790971807.352209:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+57:11610:x1877969745307136:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1790971807.354394:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+58:11610:x1877969745307136:12345-192.168.203.43@tcp:35:bash.0 Request processed in 2173us (3216us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1790971807.354429:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1790971807.417322:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.417437:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745307264 00000100:00100000:0.0:1790971807.417462:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745307264 00000100:00100000:0.0:1790971807.417570:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:0.0:1790971807.417581:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+58:11616:x1877969745307264:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971807.417612:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971807.417639:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a3b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a644 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.417766:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a3bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.417793:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a3bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.417806:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a3bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971807.417851:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790971807.417855:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971807.418120:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a3bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.418151:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e200/0xbd3388eaa6f4a3b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a644 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.418173:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a3bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a644 expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.418183:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971807.418187:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971807.418190:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12ec00, rc 0) 00000100:00100000:0.0:1790971807.418274:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:11616:x1877969745307264:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 694us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971807.418282:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:3.0:1790971807.421367:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.421578:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745307392 00000100:00100000:1.0:1790971807.421591:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745307392 00000100:00100000:1.0:1790971807.421665:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:1.0:1790971807.421676:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:11616:x1877969745307392:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971807.421703:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.421743:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a3c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a64b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.421824:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.421842:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.421854:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.421886:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.421893:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.421900:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422029:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422058:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422065:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971807.422110:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790971807.422115:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971807.422138:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422152:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422161:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422167:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422173:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422180:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971807.422185:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422194:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422208:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971807.422211:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971807.422224:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422232:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a3c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422249:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422256:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422262:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422267:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971807.422271:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422277:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422284:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971807.422286:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971807.422290:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422296:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a3d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422335:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a3c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422365:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.422372:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971807.422374:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790971807.422376:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934600, rc 0) 00000100:00100000:1.0:1790971807.422456:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11616:x1877969745307392:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 782us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.422465:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:3.0:1790971807.426117:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.426187:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.426341:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745307776 00000100:00100000:0.0:1790971807.426355:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745307776 00000100:00100000:0.0:1790971807.426432:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:0.0:1790971807.426445:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11616:x1877969745307776:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971807.426512:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971807.426552:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a3de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a652 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.426698:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.426716:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 61 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.426724:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.426732:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.426773:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.426790:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 61 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971807.426806:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766263680:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971807.426926:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 61 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.426936:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 61 pid: 7888 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971807.426945:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766263808:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971807.426979:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971807.427598:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745307520 00000100:00100000:1.0:1790971807.427608:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745307520 00010000:00010000:1.0:1790971807.427643:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 62 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.427681:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:1.0:1790971807.427690:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:2357:x1877969745307520:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971807.427704:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971807.427711:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 62 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.427723:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 62 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.427747:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971807.427752:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.427769:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.427777:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971807.427817:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:2357:x1877969745307520:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 127us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.427825:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:0.0:1790971807.433129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.433288:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745307904 00000100:00100000:2.0:1790971807.433301:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745307904 00010000:00010000:2.0:1790971807.433355:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 62 pid: 7888 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.433412:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1790971807.433424:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:2356:x1877969745307904:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971807.433448:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971807.433458:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 62 pid: 7888 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.433511:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 62 pid: 7888 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.433540:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971807.433546:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.433558:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.433567:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.433591:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971807.433671:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:2356:x1877969745307904:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 248us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.433699:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00010000:00010000:1.0:1790971807.434516:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.43@tcp) returned -22 from blocking AST (req@00000000a0fc3fd3 x1877969766263680) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 61 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.434536:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a64b expref: 61 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.434554:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766263680:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971807.434570:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a3ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a63d expref: 60 pid: 7888 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.434580:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766263808:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971807.434606:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971807.434613:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.434623:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.434629:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971807.434666:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790971807.434870:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fe00/0xbd3388eaa6f4a3de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.434888:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.434896:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971807.434899:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790971807.434901:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12e800, rc 0) 00000100:00100000:1.0:1790971807.434970:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11616:x1877969745307776:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 8528us (8781us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790971807.434978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:0.0:1790971807.443616:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.443911:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745308160 00000100:00100000:2.0:1790971807.443924:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745308160 00000100:00100000:2.0:1790971807.444004:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1790971807.444013:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11616:x1877969745308160:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:2.0:1790971807.444035:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971807.444068:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a344 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a628 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.444094:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971807.444099:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971807.444176:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:11616:x1877969745308160:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 164us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.444184:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1790971807.447181:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.447335:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745308288 00000100:00100000:1.0:1790971807.447348:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745308288 00000100:00100000:1.0:1790971807.447428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:1.0:1790971807.447438:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:11616:x1877969745308288:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:1.0:1790971807.447694:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.447714:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.447727:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790971807.448112:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1790971807.448316:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:11616:x1877969745308288:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 876us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.448326:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:0.0:1790971807.451283:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.451401:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745308416 00000100:00100000:2.0:1790971807.451416:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745308416 00000100:00100000:2.0:1790971807.451685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:2.0:1790971807.451698:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+59:11616:x1877969745308416:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971807.451725:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971807.451752:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a659 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.451892:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.451914:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.451956:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.451973:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.451990:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971807.451994:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971807.451998:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.452006:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fe00, rc 0) 00000100:00100000:2.0:1790971807.452395:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11616:x1877969745308416:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 698us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.452404:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 213 00000040:00080000:2.0:1790971807.716829:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790971807.716841:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790971807.716946:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1790971807.716954:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790971807.717645:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766263936:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790971807.717833:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957ab180 going to sleep for 11 seconds 00000100:00100000:0.0:1790971807.726937:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.727208:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745308544 00000100:00100000:2.0:1790971807.727237:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766263936:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790971807.727351:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745308544 00000100:00100000:3.0:1790971807.727421:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:3.0:1790971807.727433:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11618:x1877969745308544:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790971807.727511:0:7888:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790971807.727817:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11618:x1877969745308544:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 385us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971807.727826:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:0.0:1790971807.731190:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.731334:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745308672 00000100:00100000:2.0:1790971807.731349:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745308672 00000100:00100000:2.0:1790971807.731428:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:2.0:1790971807.731440:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11618:x1877969745308672:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790971807.731980:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732083:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732099:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732122:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732130:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732136:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732166:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732172:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732177:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971807.732219:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790971807.732276:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971807.732290:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732300:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732311:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732316:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732320:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971807.732324:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732330:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732339:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:2.0:1790971807.732341:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971807.732345:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732350:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a401 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732362:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732365:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732369:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732372:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971807.732378:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732382:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732386:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cd4a656c300) 00010000:00010000:2.0:1790971807.732387:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971807.732389:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732392:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a408 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732404:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732407:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732410:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732413:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fa00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971807.732414:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732418:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732422:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971807.732423:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971807.732429:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.732433:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a40f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.732775:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11618:x1877969745308672:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 1334us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.732785:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:1.0:1790971807.744507:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.744938:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745308928 00000100:00100000:3.0:1790971807.744954:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745308928 00000100:00100000:3.0:1790971807.745043:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:3.0:1790971807.745054:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+60:11618:x1877969745308928:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971807.745083:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971807.745113:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a416 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a660 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745264:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745282:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745295:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971807.745329:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790971807.745492:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745501:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745509:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745516:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971807.745522:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745541:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745556:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:3.0:1790971807.745559:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790971807.745565:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745571:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4a41d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745620:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a416 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a660 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745630:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:3.0:1790971807.745633:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971807.745644:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d400/0xbd3388eaa6f4a416 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a660 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.745654:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d400, rc 0) 00000100:00100000:3.0:1790971807.745737:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:11618:x1877969745308928:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 684us (1263us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1790971807.745745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:3.0:1790971807.751829:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.752415:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745309056 00000100:00100000:1.0:1790971807.752429:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745309056 00000100:00100000:1.0:1790971807.752838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:1.0:1790971807.752852:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:11618:x1877969745309056:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790971807.753107:0:5839:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790971807.753258:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:11618:x1877969745309056:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 408us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.753267:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:3.0:1790971807.760303:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.761974:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745309312 00000100:00100000:2.0:1790971807.761994:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745309312 00000100:00100000:2.0:1790971807.762085:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:2.0:1790971807.762097:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:11618:x1877969745309312:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971807.762126:0:7888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971807.762130:0:7888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790971807.762168:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12ec00/0xbd3388eaa6f4a3bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a644 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.762192:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:2.0:1790971807.762196:0:7888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971807.762212:0:7888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a42b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a667 expref: -99 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790971807.763377:0:7888:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1790971807.763674:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.763693:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.763739:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.763816:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a42b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a667 expref: 63 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.763836:0:7888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a667 expref: 62 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.763846:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:2.0:1790971807.763849:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971807.763852:0:7888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f800, rc 0) 00000100:00100000:2.0:1790971807.764727:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:11618:x1877969745309312:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 2624us (4431us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1790971807.764739:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:3.0:1790971807.768511:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.769390:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745309568 00000100:00100000:2.0:1790971807.769405:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745309568 00000100:00100000:2.0:1790971807.769503:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:2.0:1790971807.769514:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:11618:x1877969745309568:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790971807.769593:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971807.769637:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a667 expref: 62 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.769659:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd4a656c300) 00010000:00010000:2.0:1790971807.769674:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971807.769701:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.769741:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.769752:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.769956:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.769980:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.769993:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770062:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770070:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770078:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770084:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971807.770089:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770097:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770109:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:2.0:1790971807.770125:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971807.770132:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770139:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a440 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770153:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770159:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770165:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770170:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971807.770173:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770179:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770187:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa2da1256 (ffff8cd4a656c100) 00010000:00010000:2.0:1790971807.770190:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971807.770193:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.770198:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a447 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa2da1256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.770405:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:11618:x1877969745309568:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 887us (1938us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790971807.770424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:3.0:1790971807.775463:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.776151:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745309696 00000100:00100000:1.0:1790971807.776161:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745309696 00000100:00100000:1.0:1790971807.776219:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:1.0:1790971807.776230:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+61:11618:x1877969745309696:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971807.776259:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.776283:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a44e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a66e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.776322:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.776336:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.776348:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.776460:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a44e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.776520:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.776530:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971807.776533:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790971807.776537:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934a00, rc 0) 00000100:00100000:1.0:1790971807.776594:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:11618:x1877969745309696:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 366us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.776602:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:3.0:1790971807.780450:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.784333:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745309952 00000100:00100000:1.0:1790971807.784357:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745309952 00000100:00100000:1.0:1790971807.784502:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 221 00000100:00100000:1.0:1790971807.784517:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+62:11618:x1877969745309952:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790971807.784684:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.784807:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.784824:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790971807.785272:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1790971807.785363:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bba488aa reply state 000000007d837c64 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.785389:0:5839:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790971807.785541:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+64:11618:x1877969745309952:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1024us (5102us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1790971807.785550:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 221 00010000:00010000:1.0:1790971807.788234:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.788257:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.788266:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.788272:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971807.788278:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.788286:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.788307:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971807.788310:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790971807.788316:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.788322:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a45c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971807.794410:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.795922:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745310080 00000100:00100000:1.0:1790971807.795941:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745310080 00000100:00100000:1.0:1790971807.796063:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:1.0:1790971807.796075:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+63:11618:x1877969745310080:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971807.796113:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.796144:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a675 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.796221:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.796239:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.796261:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971807.796264:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790971807.796268:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934200, rc 0) 00000100:00100000:1.0:1790971807.796353:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+64:11618:x1877969745310080:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 279us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.796360:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:3.0:1790971807.802726:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.802933:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745310208 00000100:00100000:1.0:1790971807.802947:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745310208 00000100:00100000:1.0:1790971807.803206:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:1.0:1790971807.803218:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2355:x1877969745310208:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790971807.805398:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:2355:x1877969745310208:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 2165us (2670us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1790971807.805414:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1790971807.811055:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.811836:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745310464 00000100:00100000:2.0:1790971807.811851:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745310464 00000100:00100000:2.0:1790971807.812386:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1790971807.812401:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+64:11618:x1877969745310464:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790971807.813286:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+65:11618:x1877969745310464:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 884us (2242us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790971807.813297:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:3.0:1790971807.816022:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.816237:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745310720 00000100:00100000:2.0:1790971807.816251:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745310720 00000100:00100000:2.0:1790971807.816331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:2.0:1790971807.816341:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+65:11618:x1877969745310720:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790971807.816530:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+65:11618:x1877969745310720:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 188us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.816538:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:3.0:1790971807.819345:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.819759:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745310848 00000100:00100000:1.0:1790971807.819773:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745310848 00000100:00100000:1.0:1790971807.819970:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:1.0:1790971807.819982:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+65:11618:x1877969745310848:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790971807.820032:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971807.820062:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a46a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a67c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.820160:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.820180:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.820191:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971807.820236:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971807.820272:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.820302:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a46a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a67c expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.820326:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a67c expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.820335:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:1.0:1790971807.820339:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790971807.820343:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934c00, rc 0) 00000100:00100000:1.0:1790971807.820423:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+66:11618:x1877969745310848:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 443us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.820431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:3.0:1790971807.824008:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.824234:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745310976 00000100:00100000:0.0:1790971807.824248:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745310976 00000100:00100000:0.0:1790971807.824322:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:0.0:1790971807.824333:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+10:2355:x1877969745310976:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971807.824356:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971807.824384:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a683 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971807.824419:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ac00f9f, blocks: 0x1 00010000:00010000:0.0:1790971807.824444:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1790971807.824450:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971807.824461:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.824541:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.824579:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12f200, rc 0) 00000100:00100000:0.0:1790971807.824666:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:2355:x1877969745310976:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 334us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971807.824674:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1790971807.828377:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.828518:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745311232 00000100:00100000:2.0:1790971807.828539:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745311232 00000100:00100000:2.0:1790971807.828617:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:2.0:1790971807.828628:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+66:11618:x1877969745311232:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790971807.828767:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+66:11618:x1877969745311232:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 138us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.828775:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:3.0:1790971807.832026:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.832147:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745311360 00000100:00100000:2.0:1790971807.832161:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745311360 00000100:00100000:2.0:1790971807.832259:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:2.0:1790971807.832270:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:11618:x1877969745311360:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971807.832296:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971807.832321:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a68a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.832363:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.832375:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971807.832380:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971807.832387:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.832428:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.832445:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 12 pid: 6690 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.832463:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766264064:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971807.833092:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feece40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971807.836400:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.836624:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766264064:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971807.836668:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.836716:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f400, rc 0) 00000100:00100000:2.0:1790971807.836788:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:11618:x1877969745311360:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 4519us (4779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971807.836798:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:1.0:1790971807.837008:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745311488 00000100:00100000:1.0:1790971807.837018:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745311488 00010000:00010000:1.0:1790971807.837056:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 12 pid: 6690 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.837093:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:1.0:1790971807.837102:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:2356:x1877969745311488:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971807.837119:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971807.837148:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 12 pid: 6690 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.837163:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 12 pid: 6690 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.837191:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000406d8587/0xbd3388eaa6f4a478 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a683 expref: 12 pid: 6690 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.837211:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971807.837216:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971807.837226:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.837237:0:5825:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971807.837279:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971807.837306:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1877969766264192:192.168.203.43@tcp:105: 00000100:00100000:1.0:1790971807.837366:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971807.842889:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971807.843506:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1877969766264192:192.168.203.43@tcp:105: 00010000:00010000:1.0:1790971807.843547:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971807.843629:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:2356:x1877969745311488:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 6526us (7242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.843643:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1790971807.843881:0:6696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745311616 00000100:00100000:0.0:1790971807.843890:0:6696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745311616 00002000:00100000:0.0:1790971807.843963:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8cd4bddb2a00 x1877969745311616/t0(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:78/0 lens 504/0 e 0 to 0 dl 1790971818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971807.843975:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bddb2a00 with x1877969745311616 ext(0->12) 00002000:00010000:0.0:1790971807.843981:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4bddb2a00 00000100:00100000:0.0:1790971807.844013:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1790971807.844022:0:6696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+11:2357:x1877969745311616:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00010000:00010000:2.0:1790971807.845341:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971807.846415:0:6696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:2357:x1877969745311616:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 2381us (3530us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1790971807.846429:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00002000:00100000:0.0:1790971807.846447:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8cd4bddb2a00 x1877969745311616/t4294967321(0) o4->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:78/0 lens 504/448 e 0 to 0 dl 1790971818 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790971807.846458:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bddb2a00 with x1877969745311616 ext(0->12) 00002000:00010000:0.0:1790971807.846466:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4bddb2a00 00000100:00100000:3.0:1790971807.848428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.850077:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745311744 00000100:00100000:2.0:1790971807.850095:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745311744 00000100:00100000:2.0:1790971807.850237:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:2.0:1790971807.850249:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+66:11618:x1877969745311744:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790971807.896116:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000001:00080000:1.0:1790971807.896177:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:1.0:1790971807.896218:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd4a734c600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1790971807.896224:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4953b7f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4a734cf00 00000020:00080000:1.0:1790971807.896228:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4953b7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4c0337400 00000001:00080000:1.0:1790971807.896247:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1790971807.896263:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1790971807.896280:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd49feec480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1790971807.896283:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4b7345700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd48de849c0 00000020:00080000:1.0:1790971807.896286:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd4b7345f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd49f367800 00000004:00080000:1.0:1790971807.896300:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1790971807.896341:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1790971807.896652:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1790971807.897616:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790971807.897641:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766264320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790971807.897843:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971807.897926:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766264320 00000100:00100000:2.0:1790971807.897944:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766264320 00000100:00100000:2.0:1790971807.897999:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790971807.898009:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1877969766264320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790971807.898054:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1790971807.898089:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.898119:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.898130:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790971807.898136:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971807.898158:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.898190:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.898206:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 12 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.898220:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1877969766264448:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971807.899898:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766264576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790971807.900009:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971807.900569:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766264576 00000100:00100000:0.0:1790971807.900581:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766264576 00000100:00100000:0.0:1790971807.900661:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790971807.900672:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766264576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790971807.901131:0:8047:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1790971807.901177:0:8047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ac00f9e, atime: 0x6ac00f9f, ctime: 0x6ac00f9e, blocks: 0x1 00010000:00010000:0.0:1790971807.901188:0:8047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.901209:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1790971807.901215:0:8047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971807.901223:0:8047:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.901239:0:8047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.901251:0:8047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.901261:0:8047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.901295:0:8047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790971807.902340:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766264576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1663us (2324us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790971807.902352:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1790971807.902981:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd387fe9180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790971807.903004:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766264576:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790971807.903251:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feece40 going to sleep for 11 seconds 00010000:00010000:2.0:1790971807.903393:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971807.903404:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.903416:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971807.903421:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.903433:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.903455:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.903462:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a48d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.903524:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971807.904004:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971807.904009:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971807.904194:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11618:x1877969745311744:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 53937us (55768us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971807.904207:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:0.0:1790971807.911394:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971807.911884:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971807.911984:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745312000 00000100:00100000:3.0:1790971807.912017:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745312000 00010000:00010000:3.0:1790971807.912083:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 13 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971807.912141:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:3.0:1790971807.912152:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:2356:x1877969745312000:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971807.912173:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971807.912180:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 13 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.912197:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 13 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.912232:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971807.912237:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971807.912244:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.912255:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971807.912281:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971807.912349:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+13:2356:x1877969745312000:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 198us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971807.912358:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00010000:00010000:2.0:1790971807.914387:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f77f4f3/0xbd3388eaa6f4a248 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.43@tcp remote: 0x797c86479917a5e9 expref: 12 pid: 6689 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.914418:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1877969766264448:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971807.914457:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.914489:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.914498:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.914511:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.914519:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.914562:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971807.915650:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971807.915661:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.915683:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971807.915688:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.915699:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.915733:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.915740:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a486 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971807.915764:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971807.915766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971807.915768:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971807.916259:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1877969766264320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18245us (18411us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790971807.916282:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790971807.916317:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745311872 00000100:00100000:2.0:1790971807.916327:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745311872 00000004:00080000:0.0:1790971807.916426:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4be0df480/2, rc 0, transno 4294967322 00000100:00100000:0.0:1790971807.916444:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766264320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790971807.916836:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1790971807.916854:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+12:2357:x1877969745311872:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790971807.984281:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1790971807.984326:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1790971807.987937:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745311872:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 68008us (73476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971807.987958:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1790971807.994808:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971807.995412:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745312256 00000100:00100000:2.0:1790971807.995426:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745312256 00000100:00100000:2.0:1790971807.995550:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 227 00000100:00100000:2.0:1790971807.995561:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11618:x1877969745312256:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790971807.995633:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971807.995669:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934c00/0xbd3388eaa6f4a471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a67c expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.995696:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:2.0:1790971807.995702:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971807.995742:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.995759:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971807.995771:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790971807.996100:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000053fb7e36 reply state 00000000a1e000f1 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971807.996112:0:5840:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971807.996240:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:11618:x1877969745312256:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 681us (1446us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790971807.996248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 227 00010000:00010000:2.0:1790971808.000697:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.000722:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.000731:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.000739:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971808.000745:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.000754:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.000775:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:2.0:1790971808.000779:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971808.000786:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.000793:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a494 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971808.008347:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971808.009566:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745312384 00000100:00100000:2.0:1790971808.009584:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745312384 00000100:00100000:2.0:1790971808.009743:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1790971808.009756:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745312384:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790971808.010336:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790971808.010341:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790971807 00002000:00010000:2.0:1790971808.010344:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790971807 00002000:00010000:2.0:1790971808.010363:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790971807 -> 1790971807 00002000:00010000:2.0:1790971808.010365:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790971808.010607:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2356:x1877969745312384:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 852us (2273us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1790971808.010618:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00080000:1.0:1790971808.010869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971808.013081:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971808.013509:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745312640 00000100:00100000:1.0:1790971808.013523:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745312640 00000100:00100000:1.0:1790971808.013614:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:1.0:1790971808.013628:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:11618:x1877969745312640:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790971808.013719:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.013742:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.013753:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.013798:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.013817:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 20 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971808.013845:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766264704:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971808.014016:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5ccc0 going to sleep for 11 seconds 00000100:00080000:2.0:1790971808.014545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971808.017724:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1877969766264704:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971808.017770:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971808.021723:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971808.027180:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745312768 00000100:00100000:2.0:1790971808.027203:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745312768 00010000:00010000:2.0:1790971808.027276:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 21 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971808.027337:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:2.0:1790971808.027349:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:2356:x1877969745312768:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971808.027378:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971808.027387:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 21 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.027403:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 21 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.027431:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934a00/0xbd3388eaa6f4a455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a66e expref: 21 pid: 5838 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.027455:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:2.0:1790971808.027461:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.027502:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.027531:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.027574:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971808.027666:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:2356:x1877969745312768:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 318us (5955us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971808.027674:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00010000:00010000:3.0:1790971808.028367:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028380:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028421:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028429:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028438:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028444:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971808.028450:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028458:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028506:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:3.0:1790971808.028510:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790971808.028515:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.028521:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a49b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971808.028599:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11618:x1877969745312640:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 14973us (15528us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790971808.028619:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:0.0:1790971808.041759:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971808.043731:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745312896 00000100:00100000:2.0:1790971808.043753:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745312896 00000100:00100000:2.0:1790971808.043852:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:2.0:1790971808.043865:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745312896:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790971808.043948:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.043975:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.043985:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971808.043990:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971808.043996:0:6691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.044043:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.049249:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 8 pid: 6691 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971808.049322:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766264832:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971808.049455:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a060cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971808.054385:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4883f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877969766264832:192.168.203.43@tcp:104: 00010000:00010000:1.0:1790971808.054436:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971808.054627:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971808.054808:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745313024 00000100:00100000:3.0:1790971808.054818:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745313024 00010000:00010000:3.0:1790971808.054866:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 9 pid: 6691 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971808.054918:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:3.0:1790971808.054928:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+9:2357:x1877969745313024:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971808.054948:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971808.054980:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 9 pid: 6691 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.054995:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 9 pid: 6691 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.055026:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a47f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a68a expref: 9 pid: 6691 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.055046:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971808.055051:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790971808.055057:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.055068:0:5824:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971808.055127:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971808.055200:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4883f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2357:x1877969745313024:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 272us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971808.055209:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00010000:00010000:1.0:1790971808.055417:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055429:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055460:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055504:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055515:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055522:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ee00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971808.055527:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055547:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055561:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.055570:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d39386b/0xbd3388eaa6f4a4a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971808.055634:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2357:x1877969745312896:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 11771us (13891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971808.055645:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:0.0:1790971808.063375:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971808.066850:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745313280 00000100:00100000:2.0:1790971808.066871:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745313280 00000100:00100000:2.0:1790971808.066980:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 229 00000100:00100000:2.0:1790971808.066992:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11618:x1877969745313280:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790971808.067113:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.067138:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.067167:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.067552:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.067566:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.067576:0:5840:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.067622:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.067663:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 20 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971808.067680:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c0297480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766264960:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971808.067807:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a060c540 going to sleep for 11 seconds 00000100:00100000:0.0:1790971808.072565:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c0297480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766264960:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971808.072612:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971808.075036:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971808.075205:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745313408 00000100:00100000:2.0:1790971808.075226:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745313408 00010000:00010000:2.0:1790971808.075278:0:7634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 21 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971808.075378:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:2.0:1790971808.075389:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:2356:x1877969745313408:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971808.075409:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971808.075417:0:7634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 21 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.075432:0:7634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 21 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.075458:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a463 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a675 expref: 21 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.075527:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:2.0:1790971808.075534:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.075568:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.075577:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.075603:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971808.075679:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:2356:x1877969745313408:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 289us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971808.075687:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00010000:00010000:0.0:1790971808.076043:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.076054:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790971808.076322:0:5840:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1790971808.076528:0:5840:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790971808.076579:0:5840:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1790971808.076677:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1877969766265088:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790971808.076744:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971808.076784:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971808.080277:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766265088 00000100:00100000:3.0:1790971808.080300:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766265088 00000100:00100000:3.0:1790971808.080393:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790971808.080405:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877969766265088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790971808.080627:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877969766265088:12345-0@lo:1000:mdt00_002.0 Request processed in 224us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971808.080636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790971808.082013:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1790971808.082027:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4bd8a2d80, transno 4294967316 00000004:00080000:0.0:1790971808.082052:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1790971808.082078:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4be0df480, transno 4294967322 00000100:00100000:0.0:1790971808.082090:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1877969766265088:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790971808.082763:0:5840:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1790971808.082887:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1877969766265216:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790971808.082978:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971808.083020:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766265216 00000100:00100000:0.0:1790971808.083021:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971808.083030:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766265216 00000100:00100000:3.0:1790971808.083087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790971808.083097:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877969766265216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790971808.083911:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1877969766265216:12345-0@lo:1000:mdt00_002.0 Request processed in 801us (920us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1790971808.083924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790971808.086175:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1877969766265216:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1790971808.086377:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086391:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086422:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086429:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971808.086434:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086443:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086461:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b100) 00010000:00010000:0.0:1790971808.086465:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971808.086490:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086497:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a4b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086538:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086545:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086552:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086557:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971808.086559:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086575:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086584:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971808.086586:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971808.086593:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086607:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086617:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.086664:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971808.086679:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766265344:192.168.203.43@tcp:105: 00000100:00100000:0.0:1790971808.086794:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790971808.093125:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1877969766265344:192.168.203.43@tcp:105: 00010000:00010000:2.0:1790971808.093181:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093195:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a3f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093248:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093268:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093281:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093294:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093302:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093330:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093337:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971808.093342:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093351:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093366:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971808.093369:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971808.093373:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093378:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093388:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093395:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093401:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093406:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971808.093409:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093425:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093434:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971808.093437:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790971808.093440:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.093446:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971808.093811:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:11618:x1877969745313280:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 26817us (30446us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1790971808.093824:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 229 00000020:00080000:2.0:1790971808.093830:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790971808.094240:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971808.094247:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971808.094765:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790971808.094774:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790971808.098562:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971808.098660:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971808.098882:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745313536 00000100:00100000:1.0:1790971808.098896:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745313536 00000100:00100000:1.0:1790971808.098971:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745313792 00000100:00100000:1.0:1790971808.098975:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745313792 00000100:00100000:1.0:1790971808.098995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1790971808.099005:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11616:x1877969745313536:12345-192.168.203.43@tcp:49:lfs.0 00000100:00100000:1.0:1790971808.099199:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+24:11616:x1877969745313536:12345-192.168.203.43@tcp:49:lfs.0 Request processed in 194us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971808.099209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1790971808.099607:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1790971808.099617:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483294850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+23:11618:x1877969745313792:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790971808.102586:0:5841:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790971808.102724:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1790971808.102814:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.102835:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.102849:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.102860:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.102866:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.102874:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.102910:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790971808.103041:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483294850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11618:x1877969745313792:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 3421us (4374us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1790971808.103053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000020:00080000:1.0:1790971808.103060:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790971808.103542:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971808.103552:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.103561:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971808.103565:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.103575:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.103590:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cd48dd1b600) 00010000:00010000:2.0:1790971808.103594:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790971808.103599:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.103622:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971808.103647:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971808.103648:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971808.103650:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971808.104000:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971808.104202:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745314048 00000100:00100000:0.0:1790971808.104214:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745314048 00000100:00100000:0.0:1790971808.104275:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:0.0:1790971808.104285:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11616:x1877969745314048:12345-192.168.203.43@tcp:58:lfs.0 00000040:00080000:0.0:1790971808.104622:0:7888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1790971808.104713:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11616:x1877969745314048:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 429us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971808.104721:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:3.0:1790971808.164077:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971808.164576:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745314176 00000100:00100000:1.0:1790971808.164590:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745314176 00000100:00100000:1.0:1790971808.164671:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 231 00000100:00100000:1.0:1790971808.164683:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+25:11620:x1877969745314176:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971808.164735:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971808.164763:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a691 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.164862:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.164881:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.164894:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.164923:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.164931:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.164948:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.165455:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.165527:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.165539:0:5839:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.165585:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.165611:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 26 pid: 5839 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971808.165630:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766265472:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971808.165751:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790971808.177547:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1877969766265472:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971808.177590:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971808.179127:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971808.179279:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745314432 00000100:00100000:2.0:1790971808.179293:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745314432 00000100:00100000:2.0:1790971808.179371:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:2.0:1790971808.179382:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:5593:x1877969745314432:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790971808.179726:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:5593:x1877969745314432:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 344us (609us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1790971808.179735:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:1.0:1790971808.186125:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971808.188073:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745314560 00000100:00100000:0.0:1790971808.188096:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745314560 00010000:00010000:0.0:1790971808.189542:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 28 pid: 5839 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971808.189618:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:0.0:1790971808.189642:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:2356:x1877969745314560:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971808.189667:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971808.189675:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 28 pid: 5839 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.189690:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 28 pid: 5839 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.189721:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12e800/0xbd3388eaa6f4a3e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a652 expref: 28 pid: 5839 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.189741:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971808.189747:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.189759:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.189768:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971808.189833:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971808.189922:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:2356:x1877969745314560:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 293us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971808.189930:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00010000:00010000:1.0:1790971808.190694:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190707:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971808.190764:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790971808.190770:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971808.190797:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190814:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190825:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190834:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190843:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190849:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971808.190868:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190878:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190890:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:1.0:1790971808.190893:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971808.190907:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190915:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a4cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190943:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190950:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190955:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190961:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971808.190964:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190969:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190976:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cd48dd1bb00) 00010000:00010000:1.0:1790971808.190978:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971808.190988:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.190995:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a4d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.191041:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935200/0xbd3388eaa6f4a4c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a691 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.191059:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a691 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971808.191066:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:1.0:1790971808.191069:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790971808.191071:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494935c00, rc 0) 00000100:00100000:1.0:1790971808.191127:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11620:x1877969745314176:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 26446us (27075us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971808.191135:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 231 00010000:00010000:2.0:1790971808.874657:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971809.073794:0:12564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971809.073809:0:12564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971809.073862:0:12564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790971809.073868:0:12564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790971809.125180:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971809.125193:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971809.125237:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790971809.125244:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790971809.125416:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766265600:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790971809.125585:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd384d1ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971809.134184:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971809.134357:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745314688 00000100:00100000:3.0:1790971809.134951:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745314688 00000100:00100000:0.0:1790971809.135028:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1877969766265600:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790971809.135036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:3.0:1790971809.135057:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+27:11631:x1877969745314688:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790971809.135143:0:5838:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790971809.135260:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11631:x1877969745314688:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 209us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971809.135688:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:0.0:1790971809.149061:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971809.149143:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745314944 00000100:00100000:2.0:1790971809.149157:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745314944 00000100:00100000:2.0:1790971809.149240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:2.0:1790971809.149251:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+26:11631:x1877969745314944:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971809.149281:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971809.149308:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a698 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.149440:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.149458:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.149504:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971809.149519:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790971809.149686:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a4e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a698 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.151531:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a698 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.151552:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971809.151555:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971809.151559:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f200, rc 0) 00000100:00100000:2.0:1790971809.151799:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:11631:x1877969745314944:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 2546us (2750us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790971809.151811:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:0.0:1790971809.167181:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971809.168800:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745315200 00000100:00100000:2.0:1790971809.168817:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745315200 00000100:00100000:2.0:1790971809.168908:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:2.0:1790971809.168921:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:11631:x1877969745315200:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790971809.169033:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169059:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169075:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169337:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169348:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169356:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169364:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ec00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971809.169370:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169380:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169395:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971809.169399:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790971809.169405:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.169412:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a4f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971809.169631:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:11631:x1877969745315200:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 710us (2459us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790971809.169641:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 234 00000040:00080000:0.0:1790971809.170125:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790971809.170132:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790971809.170664:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790971809.170676:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790971809.171570:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971809.171622:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745315328 00000100:00100000:2.0:1790971809.171635:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745315328 00000100:00100000:2.0:1790971809.171726:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1790971809.171737:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:2356:x1877969745315328:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971809.171758:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971809.171787:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a4e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a698 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971809.171812:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971809.171818:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971809.171882:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:2356:x1877969745315328:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971809.171917:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1790971809.175216:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971809.175296:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745315584 00000100:00100000:3.0:1790971809.175309:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745315584 00000100:00100000:3.0:1790971809.175386:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1790971809.175401:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+28:11631:x1877969745315584:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790971809.175757:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:11631:x1877969745315584:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 359us (553us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790971809.175767:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00010000:00010000:0.0:1790971809.892874:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790971810.721974:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1790971810.722010:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1790971810.930770:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790971811.146787:0:12617:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790971811.146799:0:12617:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790971811.146853:0:12617:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790971811.146860:0:12617:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790971811.360335:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971811.360677:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745315840 00000100:00100000:0.0:1790971811.360690:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745315840 00000100:00100000:0.0:1790971811.360830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:0.0:1790971811.360845:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+29:11652:x1877969745315840:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971811.360947:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971811.360977:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fc00/0xbd3388eaa6f4a4fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a69f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971811.361113:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fa00/0xbd3388eaa6f4a504 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971811.361133:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fa00/0xbd3388eaa6f4a504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971811.361165:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fa00/0xbd3388eaa6f4a504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971811.361180:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790971811.361340:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fc00/0xbd3388eaa6f4a4fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a69f expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971811.361365:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fa00/0xbd3388eaa6f4a504 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a69f expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971811.361374:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971811.361377:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790971811.361381:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12fa00, rc 0) 00000100:00100000:0.0:1790971811.361463:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:11652:x1877969745315840:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 622us (1140us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1790971811.361499:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00080000:1.0:1790971811.361566:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971811.371914:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971811.371981:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745315968 00000100:00100000:2.0:1790971811.371998:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745315968 00000100:00100000:2.0:1790971811.372622:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:2.0:1790971811.372635:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:11652:x1877969745315968:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1790971811.373340:0:7888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.373364:0:7888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.373378:0:7888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.373425:0:7888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.373433:0:7888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.373440:0:7888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.373447:0:7888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971811.373452:0:7888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.373461:0:7888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.374326:0:7888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:2.0:1790971811.374333:0:7888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971811.374340:0:7888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.374347:0:7888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971811.374515:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:11652:x1877969745315968:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 1878us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971811.374527:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:0.0:1790971811.495166:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971811.495523:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316096 00000100:00100000:2.0:1790971811.495538:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316096 00000100:00100000:2.0:1790971811.495663:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:2.0:1790971811.495693:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2355:x1877969745316096:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:2.0:1790971811.495716:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971811.495743:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050037a4e/0xbd3388eaa6f4a519 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a6a6 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790971811.495776:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6ac00f9f, atime: 0x6ac00f9f, ctime: 0x6ac00f9f, blocks: 0xb 00010000:00010000:2.0:1790971811.495800:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1790971811.495805:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971811.495816:0:6690:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050037a4e/0xbd3388eaa6f4a519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6a6 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.495837:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050037a4e/0xbd3388eaa6f4a519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6a6 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971811.495851:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f800, rc 0) 00000100:00080000:1.0:1790971811.495901:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971811.495940:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2355:x1877969745316096:12345-192.168.203.43@tcp:101:cat.0 Request processed in 251us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971811.495947:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:0.0:1790971811.503253:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971811.503363:0:6694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316224 00000100:00100000:3.0:1790971811.503380:0:6694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316224 00002000:00100000:3.0:1790971811.503462:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8cd38518fb80 x1877969745316224/t0(0) o3->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:82/0 lens 488/0 e 0 to 0 dl 1790971822 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790971811.503523:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd38518fb80 with x1877969745316224 ext(0->4095) 00002000:00010000:3.0:1790971811.503530:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd38518fb80 00000100:00100000:3.0:1790971811.503574:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1790971811.503584:0:6694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2354:x1877969745316224:12345-192.168.203.43@tcp:3:cat.0 00000100:00100000:3.0:1790971811.503891:0:6694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2354:x1877969745316224:12345-192.168.203.43@tcp:3:cat.0 Request processed in 308us (656us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790971811.503900:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00002000:00100000:3.0:1790971811.503915:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8cd38518fb80 x1877969745316224/t0(0) o3->aa9b9adf-df76-49fe-88a5-1de8c4d3a597@192.168.203.43@tcp:82/0 lens 488/4536 e 0 to 0 dl 1790971822 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790971811.503924:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd38518fb80 with x1877969745316224 ext(0->4095) 00002000:00010000:3.0:1790971811.503927:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd38518fb80 00000100:00100000:0.0:1790971811.684905:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766265728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971811.685005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971811.685082:0:6692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766265728 00000100:00100000:1.0:1790971811.685095:0:6692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766265728 00000100:00100000:1.0:1790971811.685182:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790971811.685193:0:6692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766265728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790971811.687181:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790971811.687420:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971811.696686:0:6692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766265728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11480us (11665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971811.696708:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790971811.696920:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1790971811.696929:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1790971811.696958:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd387fe9180, transno 4294967310 00000100:00100000:0.0:1790971811.696998:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766265728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790971811.942120:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790971812.198165:0:8041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391137691072ns, next at 392137687537ns, rc = 0 00000100:00100000:2.0:1790971812.198198:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766265856:0@lo:400:kworker.0 00000100:00100000:2.0:1790971812.198311:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971812.198388:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790971812.198396:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766265984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971812.198429:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971812.198534:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766265856 00000100:00100000:2.0:1790971812.198537:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766265984 00000100:00100000:2.0:1790971812.198550:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766265984 00000100:00100000:3.0:1790971812.198551:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766265856 00000100:00100000:3.0:1790971812.198623:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1790971812.198637:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766265856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971812.198647:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790971812.198660:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766265984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971812.198706:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971812.198745:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766265856:12345-0@lo:400:kworker.0 Request processed in 109us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971812.198756:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1790971812.198782:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877969766265984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971812.198791:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1790971812.198824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971812.198889:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766265984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971812.198905:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766265856:0@lo:400:kworker.0 00000100:00100000:1.0:1790971812.200741:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766266496:0@lo:400:kworker.0 00000100:00100000:1.0:1790971812.200812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971812.200961:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766266112:0@lo:400:kworker.0 00000100:00100000:1.0:1790971812.200986:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971812.200999:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766266368:0@lo:400:kworker.0 00000100:00100000:0.0:1790971812.201090:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766266496 00000100:00100000:0.0:1790971812.201099:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766266496 00000100:00100000:2.0:1790971812.201147:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766266240:0@lo:400:kworker.0 00000100:00100000:3.0:1790971812.201301:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971812.201370:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766266112 00000100:00100000:3.0:1790971812.201377:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766266112 00000100:00100000:3.0:1790971812.201421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790971812.201432:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766266496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971812.201543:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877969766266496:12345-0@lo:400:kworker.0 Request processed in 113us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971812.201551:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790971812.201566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790971812.201585:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766266112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971812.201623:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766266112:12345-0@lo:400:kworker.0 Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971812.201629:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790971812.201666:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766266112:0@lo:400:kworker.0 00000100:00080000:3.0:1790971812.201719:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971812.213099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971812.213219:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766266496:0@lo:400:kworker.0 00000100:00100000:0.0:1790971812.213442:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766266368 00000100:00100000:0.0:1790971812.213452:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766266368 00000100:00100000:0.0:1790971812.213672:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790971812.213683:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766266368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971812.213780:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766266368:12345-0@lo:400:kworker.0 Request processed in 99us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971812.213788:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790971812.213939:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766266368:0@lo:400:kworker.0 00000100:00100000:2.0:1790971812.214643:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971812.223915:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766266240 00000100:00100000:3.0:1790971812.223936:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766266240 00000100:00100000:3.0:1790971812.224082:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790971812.224093:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766266240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971812.224237:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766266240:12345-0@lo:400:kworker.0 Request processed in 146us (9595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971812.224246:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790971812.224340:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766266240:0@lo:400:kworker.0 00000100:00080000:0.0:1790971812.224464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971812.263748:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971812.263785:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971812.263818:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971812.263837:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316352 00000100:00100000:1.0:1790971812.263852:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316352 00000100:00100000:3.0:1790971812.263857:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971812.263900:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971812.263935:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316608 00000100:00100000:1.0:1790971812.263937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 302 00000100:00100000:3.0:1790971812.263940:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316608 00000100:00100000:1.0:1790971812.263951:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745316352:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971812.263989:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316736 00000100:00100000:3.0:1790971812.263993:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316736 00000100:00100000:3.0:1790971812.264019:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1790971812.264049:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2354:x1877969745316352:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971812.264058:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 302 00000100:00100000:3.0:1790971812.264161:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2354:x1877969745316608:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971812.264182:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1790971812.264193:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2354:x1877969745316736:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971812.264218:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2354:x1877969745316608:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 61us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971812.264228:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+8:2354:x1877969745316736:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971812.264230:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1790971812.264245:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:3.0:1790971812.264258:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316864 00000100:00100000:3.0:1790971812.264263:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316864 00000100:00100000:3.0:1790971812.264294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:3.0:1790971812.264303:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745316864:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971812.264306:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316480 00000100:00100000:1.0:1790971812.264312:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316480 00000100:00100000:3.0:1790971812.264339:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2354:x1877969745316864:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 38us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971812.264346:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:1.0:1790971812.264502:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:2354:x1877969745316480:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971812.264538:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+31:2354:x1877969745316480:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 183us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971812.265885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00080000:3.0:1790971812.265942:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790971812.265949:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971812.270297:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 166 00010000:00010000:0.0:1790971812.965877:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790971813.272367:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1790971813.272391:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1790971813.325260:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1790971813.325292:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cd4956b26c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1790971813.325299:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd49bcc0400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4956b2f00 00000020:00080000:1.0:1790971813.325303:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cd49bcc0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cd4bdd41800 00000020:00080000:1.0:1790971813.325334:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:1.0:1790971813.325355:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:3.0:1790971813.325450:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790971813.325721:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1790971813.325874:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387fe9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766266624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790971813.325972:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971813.326361:0:6690:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766266624 00000100:00100000:3.0:1790971813.326372:0:6690:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766266624 00000100:00100000:3.0:1790971813.326435:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790971813.326446:0:6690:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766266624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790971813.326722:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790971813.326726:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790971807 -> 1790971807 00002000:00010000:3.0:1790971813.326729:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1790971807 -> 1790971807 00002000:00010000:3.0:1790971813.326731:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790971807 -> 1790971807 00002000:00010000:3.0:1790971813.326734:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790971813.326791:0:6690:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766266624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 346us (818us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1790971813.326800:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790971813.327156:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1790971813.327164:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1790971813.327194:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cd387fe9500 x1877969766266624/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790971829 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790971813.327208:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd387fe9500/2, rc 0, transno 4294967325 00000100:00100000:2.0:1790971813.327213:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387fe9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766266624:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1790971813.991969:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790971814.310771:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790971814.310784:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790971814.310848:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790971814.310872:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790971815.012787:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971815.832179:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971815.832278:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745316992 00000100:00100000:0.0:1790971815.832291:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745316992 00000100:00100000:0.0:1790971815.832381:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:0.0:1790971815.832391:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11297:x1877969745316992:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790971815.832536:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11297:x1877969745316992:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 146us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971815.832545:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00080000:3.0:1790971815.833034:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971815.837534:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971815.837692:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745317248 00000100:00100000:0.0:1790971815.837702:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745317248 00000100:00100000:0.0:1790971815.837767:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:0.0:1790971815.837777:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:11297:x1877969745317248:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790971815.839164:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:11297:x1877969745317248:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1381us (1632us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790971815.839196:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00010000:00010000:0.0:1790971816.036743:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971816.804970:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790971816.804994:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766266752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971816.805064:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971816.805175:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766266752 00000100:00100000:2.0:1790971816.805184:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766266752 00000100:00100000:2.0:1790971816.805248:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790971816.805257:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766266752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971816.805291:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971816.805348:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766266752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971816.805355:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790971816.805466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790971816.805533:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766266752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790971817.062625:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971817.317092:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790971817.317124:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766266880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971817.317311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971817.317454:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766266880 00000100:00100000:3.0:1790971817.317494:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766266880 00000100:00100000:3.0:1790971817.317551:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790971817.317559:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766266880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790971817.317594:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971817.317648:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766266880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971817.317655:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790971817.317699:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766266880:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790971817.318036:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971817.318397:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971817.318492:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790971817.318506:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766267392:0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.318544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971817.318576:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267392 00000100:00100000:3.0:1790971817.318580:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267392 00000100:00100000:3.0:1790971817.318609:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790971817.318615:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766267392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.318664:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766267392:12345-0@lo:400:kworker.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971817.318670:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790971817.318716:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766267392:0@lo:400:kworker.0 00000100:00100000:0.0:1790971817.318776:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766267136:0@lo:400:kworker.0 00000100:00100000:0.0:1790971817.318811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971817.318846:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971817.318852:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766267264:0@lo:400:kworker.0 00000100:00100000:0.0:1790971817.318876:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971817.318927:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267136 00000100:00100000:3.0:1790971817.318932:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267136 00000100:00100000:3.0:1790971817.318963:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267264 00000100:00100000:3.0:1790971817.318966:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267264 00000100:00100000:3.0:1790971817.318992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790971817.318999:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766267136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.319038:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766267136:12345-0@lo:400:kworker.0 Request processed in 39us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971817.319044:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790971817.319056:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790971817.319063:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766267264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.319088:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766267264:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971817.319094:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1790971817.319121:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971817.319149:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766267264:0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.319158:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766267136:0@lo:400:kworker.0 00000100:00100000:2.0:1790971817.319440:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766267008:0@lo:400:kworker.0 00000100:00100000:2.0:1790971817.319555:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971817.319693:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267008 00000100:00100000:3.0:1790971817.319698:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267008 00000100:00100000:2.0:1790971817.319857:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1790971817.319867:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766267008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971817.319916:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3302:x1877969766267008:12345-0@lo:400:kworker.0 Request processed in 52us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971817.319923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790971817.319982:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766267008:0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.320123:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971817.320132:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766267520:0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.320171:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971817.320403:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267520 00000100:00100000:1.0:1790971817.320408:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267520 00000100:00100000:1.0:1790971817.320450:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790971817.320458:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766267520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971817.320526:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766267520:12345-0@lo:400:kworker.0 Request processed in 69us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971817.320533:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1790971817.321489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971817.321522:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766267520:0@lo:400:kworker.0 00000100:00100000:3.0:1790971817.388100:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971817.389528:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745317376 00000100:00100000:1.0:1790971817.389541:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745317376 00000100:00100000:1.0:1790971817.389598:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 304 00000100:00100000:1.0:1790971817.389606:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745317376:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971817.389688:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488388850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2357:x1877969745317376:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 82us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971817.389697:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 304 00000100:00100000:1.0:1790971817.399306:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971817.399350:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971817.399373:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971817.399395:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971817.399419:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745317760 00000100:00100000:1.0:1790971817.399428:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745317760 00000100:00100000:1.0:1790971817.399495:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745317632 00000100:00100000:1.0:1790971817.399498:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745317632 00000100:00100000:1.0:1790971817.399525:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:1.0:1790971817.399533:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745317760:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971817.399604:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2356:x1877969745317760:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971817.399612:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:1.0:1790971817.399628:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1790971817.399635:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745317632:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971817.399661:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2357:x1877969745317632:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971817.399667:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1790971817.399687:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745317504 00000100:00100000:1.0:1790971817.399690:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745317504 00000100:00100000:1.0:1790971817.399716:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745317888 00000100:00100000:1.0:1790971817.399719:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745317888 00000100:00100000:1.0:1790971817.399738:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:1.0:1790971817.399753:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:2356:x1877969745317504:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971817.399789:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:2356:x1877969745317504:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971817.399796:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:1.0:1790971817.399809:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:1.0:1790971817.399815:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745317888:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971817.399851:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:2357:x1877969745317888:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971817.399857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00080000:1.0:1790971817.399873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790971817.399878:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790971817.399880:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1790971817.696147:0:12816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:10:16 (1790971816) 00010000:00010000:2.0:1790971818.084970:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790971818.397659:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1790971818.407047:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1790971818.407064:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1790971818.407258:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1790971818.407268:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790971819.108716:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971820.132670:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971820.304757:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971820.304843:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745318016 00000100:00100000:1.0:1790971820.304855:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745318016 00000100:00100000:1.0:1790971820.304933:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00100000:1.0:1790971820.304944:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+5:12318:x1877969745318016:12345-192.168.203.43@tcp:101:lsof.0 00010000:00010000:1.0:1790971820.304966:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971820.304993:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a6ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971820.305060:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a527 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971820.305092:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971820.305104:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971820.305141:0:5838:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790971820.305145:0:5838:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971820.305182:0:5838:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971820.305220:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934200/0xbd3388eaa6f4a520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6ad expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971820.305237:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6ad expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971820.305245:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:1.0:1790971820.305248:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971820.305251:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934600, rc 0) 00000100:00100000:1.0:1790971820.305313:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:12318:x1877969745318016:12345-192.168.203.43@tcp:101:lsof.0 Request processed in 372us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971820.305321:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00080000:2.0:1790971820.305673:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790971821.157520:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971821.924790:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790971821.924824:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766267648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790971821.924907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971821.925098:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267648 00000100:00100000:3.0:1790971821.925107:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267648 00000100:00100000:3.0:1790971821.925170:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790971821.925180:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766267648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971821.925215:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971821.925265:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766267648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971821.925272:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1790971821.925375:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971821.925411:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766267648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790971822.180686:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971822.333791:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971822.333890:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745318272 00000100:00100000:0.0:1790971822.333901:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745318272 00000100:00100000:0.0:1790971822.333985:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:0.0:1790971822.333998:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+18:12319:x1877969745318272:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:0.0:1790971822.334377:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:12319:x1877969745318272:12345-192.168.203.43@tcp:35:umount.0 Request processed in 381us (594us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1790971822.334386:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00080000:2.0:1790971822.334585:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790971822.342551:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971822.342649:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745318528 00000100:00100000:1.0:1790971822.342659:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745318528 00000100:00100000:1.0:1790971822.342715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1790971822.342725:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+19:12319:x1877969745318528:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:1.0:1790971822.343100:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:12319:x1877969745318528:12345-192.168.203.43@tcp:35:umount.0 Request processed in 375us (556us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1790971822.343109:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:3.0:1790971822.346651:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971822.347309:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745318784 00000100:00100000:1.0:1790971822.347322:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745318784 00000100:00100000:1.0:1790971822.347383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1790971822.347392:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd483297c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+20:12319:x1877969745318784:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:1.0:1790971822.347694:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd483297c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:12319:x1877969745318784:12345-192.168.203.43@tcp:35:umount.0 Request processed in 302us (1050us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790971822.347703:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1790971822.356922:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971822.356999:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745319040 00000100:00100000:0.0:1790971822.357010:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745319040 00000100:00100000:0.0:1790971822.357065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:0.0:1790971822.357075:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+21:12319:x1877969745319040:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:0.0:1790971822.357402:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:12319:x1877969745319040:12345-192.168.203.43@tcp:35:umount.0 Request processed in 327us (490us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1790971822.357411:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1790971822.362975:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971822.363036:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971822.363069:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971822.363105:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971822.363134:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745319552 00000100:00100000:2.0:1790971822.363148:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745319552 00000100:00100000:2.0:1790971822.363198:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745319808 00000100:00100000:2.0:1790971822.363201:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745319808 00000100:00100000:2.0:1790971822.363212:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745319680 00000100:00100000:2.0:1790971822.363214:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745319680 00000100:00100000:2.0:1790971822.363228:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971822.363235:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+15:2355:x1877969745319552:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971822.363251:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971822.363270:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbd600/0xbd3388eaa6f495ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a23f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971822.363290:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971822.363338:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+14:2355:x1877969745319552:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971822.363346:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971822.363362:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1790971822.363368:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+13:2355:x1877969745319808:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971822.363376:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971822.363385:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4bdd5e200/0xbd3388eaa6f49797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a30a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971822.363393:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971822.363410:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+12:2355:x1877969745319808:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 42us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971822.363417:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1790971822.363428:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1790971822.363434:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+11:2355:x1877969745319680:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971822.363451:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971822.363460:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494935a00/0xbd3388eaa6f49513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a207 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971822.363517:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971822.363537:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2355:x1877969745319680:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 102us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971822.363543:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1790971822.364018:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745319424 00000100:00100000:1.0:1790971822.364025:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745319424 00000100:00100000:1.0:1790971822.364081:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:1.0:1790971822.364089:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4afc17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2353:x1877969745319424:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:1.0:1790971822.364114:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49aed 00000020:00010000:1.0:1790971822.364120:0:6691:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cd487b65000: total 0 00000100:00080000:1.0:1790971822.364125:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cd487b67000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790971822.364165:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1790971822.364402:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4afc17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2353:x1877969745319424:12345-192.168.203.43@tcp:9:umount.0 Request processed in 313us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971822.364409:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000020:00010000:1.0:1790971822.364563:0:5828:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cd487b65000: total 0 00010000:00010000:1.0:1790971822.364582:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cd487b65000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790971822.364637:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050037a4e/0xbd3388eaa6f4a519 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6a6 expref: 4 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971822.364688:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000285b906a/0xbd3388eaa6f49e89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4df expref: 3 pid: 8047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971822.364703:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cd487b65000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790971822.364715:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971822.364717:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971822.364719:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790971822.365453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790971822.373780:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971822.373884:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745319936 00000100:00100000:1.0:1790971822.373895:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745319936 00000100:00080000:2.0:1790971822.373953:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971822.373967:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:1.0:1790971822.373977:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+5:2353:x1877969745319936:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:1.0:1790971822.374006:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49885 00000100:00080000:1.0:1790971822.374015:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cd4b70db000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790971822.374062:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1790971822.374179:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971822.374337:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+2:2353:x1877969745319936:12345-192.168.203.43@tcp:9:umount.0 Request processed in 361us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971822.374345:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:3.0:1790971822.385723:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971822.386673:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745320960 00000100:00100000:1.0:1790971822.386685:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745320960 00000100:00100000:1.0:1790971822.386827:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00100000:1.0:1790971822.386841:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+22:2353:x1877969745320960:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:1.0:1790971822.386891:0:5839:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49521 00000020:00010000:1.0:1790971822.386911:0:5839:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cd4aff9d000: total 0 00000100:00080000:1.0:1790971822.386916:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8cd494dd7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790971822.386950:0:5839:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1790971822.387128:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cd4aff9d000: total 0 00010000:00010000:0.0:1790971822.387178:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cd4aff9d000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1790971822.387219:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cd487fd8200) 00010000:00010000:0.0:1790971822.387223:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971822.387231:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbda00/0xbd3388eaa6f497eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a318 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387258:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971822.387260:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790971822.387263:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd49bcbd400/0xbd3388eaa6f49e74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4d8 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387274:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971822.387276:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971822.387279:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f49d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a492 expref: 19 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387291:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971822.387294:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971822.387297:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494935c00/0xbd3388eaa6f4a4da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a691 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387309:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971822.387311:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790971822.387315:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42a00/0xbd3388eaa6f4985b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a334 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387327:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:0.0:1790971822.387330:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971822.387333:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f49edd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4f4 expref: 16 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387359:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cd48dd1bc00) 00010000:00010000:0.0:1790971822.387362:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790971822.387379:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43e00/0xbd3388eaa6f49b48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a406 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387399:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971822.387401:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790971822.387405:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12f400/0xbd3388eaa6f4a1d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a5cd expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387417:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971822.387419:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790971822.387423:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4be12fa00/0xbd3388eaa6f4a504 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a69f expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387433:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cd4a656cd00) 00010000:00010000:0.0:1790971822.387435:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790971822.387439:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f49ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4fb expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387455:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:0.0:1790971822.387458:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971822.387462:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f49807 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a31f expref: 11 pid: 7888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387534:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cd487fd8400) 00010000:00010000:0.0:1790971822.387537:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971822.387548:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c600/0xbd3388eaa6f49e4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a4ca expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387572:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cd48dd1b900) 00010000:00010000:0.0:1790971822.387574:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971822.387578:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fe00/0xbd3388eaa6f4a3fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a659 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971822.387590:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cd4aff9d000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1790971822.387605:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971822.387607:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971822.387609:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971822.390911:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa9b9adf-df76-49fe-88a5-1de8c4d3a597+7:2353:x1877969745320960:12345-192.168.203.43@tcp:39:umount.0 Request processed in 4065us (5189us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1790971822.390927:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00100000:0.0:1790971822.437073:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766267776:0@lo:400:kworker.0 00000100:00100000:0.0:1790971822.437160:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971822.437236:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766268288:0@lo:400:kworker.0 00000100:00100000:0.0:1790971822.437264:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971822.437301:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790971822.437307:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766268160:0@lo:400:kworker.0 00000100:00100000:0.0:1790971822.437330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971822.437359:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268288 00000100:00100000:0.0:1790971822.437366:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268288 00000100:00100000:0.0:1790971822.437455:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790971822.437466:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766268288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971822.437571:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766268288:12345-0@lo:400:kworker.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971822.437578:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1790971822.437608:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971822.437622:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268160 00000100:00100000:0.0:1790971822.437646:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268160 00000100:00100000:0.0:1790971822.437680:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790971822.437687:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766268160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971822.437746:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766268160:12345-0@lo:400:kworker.0 Request processed in 43us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971822.437752:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790971822.437809:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766268160:0@lo:400:kworker.0 00000100:00100000:0.0:1790971822.437822:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766268288:0@lo:400:kworker.0 00000100:00100000:2.0:1790971822.438295:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267776 00000100:00100000:2.0:1790971822.438301:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267776 00000100:00100000:2.0:1790971822.438353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790971822.438361:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766267776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971822.438445:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48838bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3305:x1877969766267776:12345-0@lo:400:kworker.0 Request processed in 84us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971822.438452:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790971822.438517:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766267776:0@lo:400:kworker.0 00000100:00100000:3.0:1790971822.438805:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766267904:0@lo:400:kworker.0 00000100:00100000:3.0:1790971822.438852:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971822.438894:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766268416:0@lo:400:kworker.0 00000100:00100000:3.0:1790971822.438925:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971822.438945:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971822.438952:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766268032:0@lo:400:kworker.0 00000100:00100000:3.0:1790971822.438978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971822.439016:0:8047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268416 00000100:00100000:3.0:1790971822.439020:0:8047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268416 00000100:00100000:3.0:1790971822.439077:0:8047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790971822.439084:0:8047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766268416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971822.439260:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766267904 00000100:00100000:1.0:1790971822.439266:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766267904 00000100:00100000:1.0:1790971822.439288:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268032 00000100:00100000:1.0:1790971822.439291:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268032 00000100:00100000:1.0:1790971822.439308:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790971822.439314:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766267904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971822.439390:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766267904:12345-0@lo:400:kworker.0 Request processed in 75us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971822.439404:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790971822.439419:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790971822.439425:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766268032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971822.439487:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be18b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766268032:12345-0@lo:400:kworker.0 Request processed in 37us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971822.439501:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1790971822.439545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790971822.439550:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971822.439589:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766268032:0@lo:400:kworker.0 00000100:00100000:1.0:1790971822.439609:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766267904:0@lo:400:kworker.0 00000100:00100000:3.0:1790971822.439966:0:8047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766268416:12345-0@lo:400:kworker.0 Request processed in 882us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971822.439974:0:8047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790971822.440318:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766268544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971822.440362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971822.441155:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1790971822.441162:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd387fe9500, transno 4294967325 00000100:00100000:1.0:1790971822.441182:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766268416:0@lo:400:kworker.0 00000100:00100000:2.0:1790971822.441726:0:6693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268544 00000100:00100000:2.0:1790971822.441827:0:6693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268544 00000100:00100000:2.0:1790971822.441879:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790971822.441888:0:6693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766268544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971822.441918:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971822.441987:0:6693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766268544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971822.442004:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790971822.442512:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766268544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971822.507724:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971822.514016:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745321088 00000100:00100000:2.0:1790971822.514455:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745321088 00000100:00100000:2.0:1790971822.514624:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:2.0:1790971822.514635:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2356:x1877969745321088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971822.514730:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2356:x1877969745321088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 97us (7015us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971822.514738:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00080000:1.0:1790971822.521374:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790971823.205513:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790971823.518286:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1790971823.518308:0:5861:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000001:00080000:3.0:1790971823.518314:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1790971823.518322:0:5861:0:(genops.c:885:class_export_put()) final put ffff8cd4aff9d000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:3.0:1790971823.518347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4aff9d000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 for lustre-MDT0000 00000020:00000080:3.0:1790971823.518399:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd494dd7800 for lustre-MDT0000 00000001:00100000:3.0:1790971823.561805:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:3.0:1790971823.561814:0:7646:0:(genops.c:885:class_export_put()) final put ffff8cd487b65000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:3.0:1790971823.561839:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd487b65000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 for lustre-OST0001 00000020:00000080:3.0:1790971823.561879:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd487b67000 for lustre-OST0001 00010000:00010000:2.0:1790971824.230589:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971824.549263:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790971824.549277:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790971824.550420:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1790971824.550430:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790971824.826004:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971824.826049:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971824.826101:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971824.826191:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745321216 00000100:00100000:2.0:1790971824.826192:0:7634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745321472 00000100:00100000:3.0:1790971824.826201:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745321216 00000100:00100000:2.0:1790971824.826201:0:7634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745321472 00000100:00100000:1.0:1790971824.826269:0:5826:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745321344 00000100:00100000:1.0:1790971824.826273:0:5826:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745321344 00000100:00100000:3.0:1790971824.826336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1790971824.826346:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6100ea-73af-4d7b-ad21-580f22f81181+12:2357:x1877969745321216:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971824.826361:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971824.826380:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd42000/0xbd3388eaa6f495f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a254 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971824.826399:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971824.826459:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6100ea-73af-4d7b-ad21-580f22f81181+11:2357:x1877969745321216:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 114us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971824.826514:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:2.0:1790971824.829692:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1790971824.829709:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+11:2357:x1877969745321472:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971824.829725:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971824.829744:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc600/0xbd3388eaa6f49790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a303 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971824.829761:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971824.829829:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b6100ea-73af-4d7b-ad21-580f22f81181+10:2357:x1877969745321472:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 127us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971824.829838:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1790971824.831198:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1790971824.831212:0:5826:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6100ea-73af-4d7b-ad21-580f22f81181+9:2357:x1877969745321344:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971824.831226:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971824.831242:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d58a00/0xbd3388eaa6f495fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a27e expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971824.831261:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971824.831312:0:5826:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6100ea-73af-4d7b-ad21-580f22f81181+8:2357:x1877969745321344:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 104us (5210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971824.831319:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1790971824.836397:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971824.836654:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745321728 00000100:00100000:2.0:1790971824.836664:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745321728 00000100:00100000:2.0:1790971824.836726:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 240 00000100:00100000:2.0:1790971824.836736:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+6:2353:x1877969745321728:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:2.0:1790971824.836789:0:5840:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49608 00000020:00010000:2.0:1790971824.836811:0:5840:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cd4be09b800: total 0 00000100:00080000:2.0:1790971824.836816:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8cd4be098000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790971824.836850:0:5840:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1790971824.836903:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cd4be09b800: total 0 00010000:00010000:3.0:1790971824.836908:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971824.836954:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cd4be09b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790971824.836986:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040600) 00010000:00010000:3.0:1790971824.836991:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971824.837000:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd494934600/0xbd3388eaa6f4a527 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6ad expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971824.837026:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cd4be09b800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790971824.837036:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971824.837038:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971824.837040:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790971824.837180:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971824.837774:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be25fcca-2306-4aa1-b74f-3903af7f4a28+3:2353:x1877969745321728:12345-192.168.203.43@tcp:39:umount.0 Request processed in 1036us (1383us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1790971824.837793:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 240 00000100:00100000:0.0:1790971824.860580:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971824.860718:0:5832:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745321984 00000100:00100000:2.0:1790971824.860728:0:5832:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745321984 00000100:00100000:2.0:1790971824.860838:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 306 00000100:00100000:2.0:1790971824.860850:0:5832:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+7:2353:x1877969745321984:12345-192.168.203.43@tcp:251:umount.0 00000020:00000080:2.0:1790971824.860896:0:5832:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f494fe 00000020:00010000:2.0:1790971824.860904:0:5832:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cd4be190800: total 0 00000100:00080000:2.0:1790971824.860909:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8cd4be195000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790971824.860982:0:5832:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6100ea-73af-4d7b-ad21-580f22f81181+3:2353:x1877969745321984:12345-192.168.203.43@tcp:251:umount.0 Request processed in 134us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971824.860990:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 306 00000020:00010000:1.0:1790971824.862243:0:5828:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cd4be190800: total 0 00010000:00010000:1.0:1790971824.862291:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cd4be190800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790971824.862327:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f495b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a246 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971824.862345:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cd4be190800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790971824.862356:0:5828:0:(genops.c:885:class_export_put()) final put ffff8cd4be190800/7b6100ea-73af-4d7b-ad21-580f22f81181 00010000:00010000:1.0:1790971824.862378:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971824.862380:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971824.862382:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790971824.862604:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be190800/7b6100ea-73af-4d7b-ad21-580f22f81181 for MGS 00000020:00000080:3.0:1790971824.862650:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4be195000 for MGS 00010000:00010000:1.0:1790971825.253674:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790971826.112568:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:1.0:1790971826.112577:0:6714:0:(genops.c:885:class_export_put()) final put ffff8cd4b70dc000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 00000020:00000080:1.0:1790971826.112617:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4b70dc000/aa9b9adf-df76-49fe-88a5-1de8c4d3a597 for lustre-OST0000 00000020:00000080:1.0:1790971826.112666:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4b70db000 for lustre-OST0000 00010000:00010000:3.0:1790971826.277946:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790971826.380891:0:13020:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790971826.399256:0:13020:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790971826.399301:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.399315:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.399322:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.399329:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.399357:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790971826.399362:0:13020:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790971826.399386:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790971826.399391:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790971826.399396:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790971826.399418:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8cd494dd5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1790971826.399496:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971826.399503:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971826.399510:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d58e00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971826.399514:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971826.399522:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971826.399529:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971826.399552:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790971826.399555:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790971826.399557:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790971826.399580:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971826.399581:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766268672:0@lo:39:umount.0 00010000:00010000:2.0:1790971826.399586:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971826.399603:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971826.399609:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd487d58e00/0xbd3388eaa6f49583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4958a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971826.399624:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971826.399626:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971826.399627:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971826.399637:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766268800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971826.399641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971826.399736:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971826.399811:0:7888:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268672 00000100:00100000:2.0:1790971826.399818:0:7888:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268672 00000100:00100000:2.0:1790971826.399858:0:7888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790971826.399866:0:7888:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877969766268672:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790971826.399890:0:7888:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f4930d 00000100:00080000:2.0:1790971826.399897:0:7888:0:(import.c:65:import_set_state_nolock()) ffff8cd49feda800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790971826.399951:0:7888:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1877969766268672:12345-0@lo:39:umount.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971826.399957:0:7888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:2.0:1790971826.399966:0:7888:0:(genops.c:885:class_export_put()) final put ffff8cd49fedb000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1790971826.399996:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790971826.400004:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd49fedb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790971826.400049:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd49feda800 for lustre-MDT0000 00000100:00100000:1.0:1790971826.400603:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268800 00000100:00100000:1.0:1790971826.400609:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268800 00000100:00100000:1.0:1790971826.400657:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790971826.400665:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+19:3304:x1877969766268800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971826.400684:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971826.400699:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc200/0xbd3388eaa6f4958a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f49583 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.400711:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971826.400763:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3304:x1877969766268800:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971826.400780:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790971826.401288:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd494dd5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790971826.401312:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766268672:0@lo:39:umount.0 00000100:00100000:2.0:1790971826.401353:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766268800:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1790971826.401415:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790971826.401419:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790971826.401424:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790971826.402628:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402645:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402652:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402659:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402694:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971826.402702:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402709:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402730:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402737:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402751:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790971826.402757:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402773:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.402776:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790971826.402779:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.402782:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402785:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.402789:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbce00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971826.402793:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.402802:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402803:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790971826.402808:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971826.402809:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402814:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971826.402821:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790971826.402821:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971826.402824:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790971826.402835:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971826.402843:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1790971826.402847:0:13020:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790971826.402850:0:13020:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1790971826.402854:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.402859:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:1.0:1790971826.402872:0:13020:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1790971826.402875:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1790971826.402876:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1790971826.402879:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1790971826.402881:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbce00/0xbd3388eaa6f49591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f49598 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790971826.402884:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1790971826.402890:0:13020:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cd4be190000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1790971826.402894:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:1.0:1790971826.402895:0:13020:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cd385015800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1790971826.402897:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790971826.402902:0:13020:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8cd4be09b800 be25fcca-2306-4aa1-b74f-3903af7f4a28 192.168.203.43@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1790971826.402903:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935800 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971826.402906:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790971826.402907:0:13020:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8cd4956919c0) has exports, disconnecting them 00010000:00010000:3.0:1790971826.402912:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790971826.402912:0:13020:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cd4be190000), last request at 1790971822 10000000:00010000:3.0:1790971826.402918:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790971826.402918:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49480 10000000:01000000:3.0:1790971826.402923:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790971826.402924:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790971826.402926:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:1.0:1790971826.402933:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8cd4be196800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790971826.402943:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.402948:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790971826.402963:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.402969:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494935800/0xbd3388eaa6f494b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f494bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790971826.402971:0:13020:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cd4be190000): rc 0 00000020:00000080:1.0:1790971826.402974:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4be190000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1790971826.402981:0:13020:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cd385015800), last request at 1790971822 00010000:00010000:3.0:1790971826.402983:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:1.0:1790971826.402984:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f493b5 00010000:00010000:3.0:1790971826.402986:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790971826.402990:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8cd385016000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790971826.402991:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c400 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971826.402994:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790971826.402995:0:13020:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cd385015800): rc 0 00000020:00000080:1.0:1790971826.402997:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd385015800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1790971826.403001:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971826.403007:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1790971826.403008:0:13020:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa77fc47e3ae0 10000000:01000000:3.0:1790971826.403011:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790971826.403013:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790971826.403015:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790971826.403024:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790971826.403025:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790971826.403028:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:3.0:1790971826.403030:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790971826.403035:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790971826.403044:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1790971826.403045:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f497ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f497c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.403053:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971826.403056:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.403061:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934400 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971826.403064:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.403070:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971826.403076:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971826.403082:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790971826.403084:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790971826.403086:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790971826.403096:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.403102:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1790971826.403104:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1790971826.403107:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971826.403114:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494934400/0xbd3388eaa6f4926c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f49273 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790971826.403114:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8cd387494800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790971826.403123:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790971826.403125:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1790971826.403131:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1790971826.403134:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971826.403136:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971826.403138:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971826.403169:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766269056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971826.403237:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971826.403279:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971826.403285:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766269184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971826.403306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790971826.403324:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971826.403333:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766268928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971826.403339:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269056 00000100:00100000:3.0:1790971826.403345:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269056 00000100:00100000:2.0:1790971826.403359:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971826.403377:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971826.403380:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269184 00000100:00100000:3.0:1790971826.403382:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269184 00000100:00100000:2.0:1790971826.403382:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4c032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766269312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971826.403394:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766268928 00000100:00100000:3.0:1790971826.403396:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766268928 00000100:00100000:2.0:1790971826.403400:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971826.403405:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269312 00000100:00100000:3.0:1790971826.403407:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269312 00000020:00000080:2.0:1790971826.403418:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be190000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1790971826.403421:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790971826.403428:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+21:3302:x1877969766269056:12345-0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1790971826.403463:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd385015800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790971826.403502:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4be196800 for lustre-MDT0000 00000020:00000080:2.0:1790971826.403506:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd385016000 for lustre-MDT0000 00000100:00100000:2.0:1790971826.403524:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790971826.403531:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+21:3302:x1877969766269184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790971826.403541:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971826.403554:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f497c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f497ba expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971826.403565:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971826.403597:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790971826.403600:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+20:3302:x1877969766269184:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1790971826.403607:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd42600/0xbd3388eaa6f494bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f494b8 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971826.403607:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1790971826.403620:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971826.403631:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790971826.403637:0:7634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3305:x1877969766268928:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971826.403643:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+18:3302:x1877969766269056:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (407us total) trans 0 rc 0/0 00010000:00010000:2.0:1790971826.403645:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790971826.403649:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1790971826.403653:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d58c00/0xbd3388eaa6f49598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f49591 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971826.403660:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1790971826.403665:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971826.403672:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3305:x1877969766269312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790971826.403680:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971826.403687:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494881a00/0xbd3388eaa6f49273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f4926c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971826.403688:0:7634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0404db5-d37b-41bb-8054-1f8859117a4f+16:3305:x1877969766268928:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971826.403693:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1790971826.403698:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971826.403718:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3305:x1877969766269312:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971826.403723:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790971826.403725:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766269312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790971826.403732:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766268928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790971826.403755:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766269440:0@lo:9:umount.0 00000100:00100000:2.0:1790971826.403798:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971826.403828:0:6691:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269440 00000100:00100000:2.0:1790971826.403831:0:6691:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269440 00000100:00100000:2.0:1790971826.403866:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790971826.403872:0:6691:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877969766269440:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790971826.403892:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49402 00000100:00080000:2.0:1790971826.403898:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cd384ded000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790971826.403930:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1790971826.404121:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971826.404502:0:6691:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3301:x1877969766269440:12345-0@lo:9:umount.0 Request processed in 628us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971826.404510:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1790971826.404529:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971826.404555:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766269184:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790971826.404559:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd387494800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790971826.404575:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4c032fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766269056:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1790971826.404580:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790971826.404584:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790971826.404587:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766269440:0@lo:9:umount.0 00010000:00010000:0.0:1790971826.404807:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790971826.404956:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790971826.404977:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8cd4883e9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790971826.405028:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766269568:0@lo:9:umount.0 00000100:00100000:3.0:1790971826.405066:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790971826.405145:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cd4956919c0) has no exports 00000100:00100000:0.0:1790971826.405269:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269568 00000100:00100000:0.0:1790971826.405275:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269568 00000100:00100000:0.0:1790971826.405323:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790971826.405332:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877969766269568:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790971826.405351:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f494e9 00000100:00080000:0.0:1790971826.405359:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8cd4be191000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790971826.405383:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1790971826.405707:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790971826.405938:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971826.408042:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3301:x1877969766269568:12345-0@lo:9:umount.0 Request processed in 2703us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971826.408054:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1790971826.408335:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4883e9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790971826.408356:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790971826.408359:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790971826.408363:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766269568:0@lo:9:umount.0 00000020:00080000:3.0:1790971826.415988:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cd4956919c0) has no exports 00000020:00000080:3.0:1790971826.476339:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f492c7 00000020:00000080:3.0:1790971826.476355:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4b7043800/lustre-QMT0000_UUID 00000020:01000000:3.0:1790971826.476416:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790971826.476537:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790971826.476547:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790971826.476551:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8cd49fdd0000) has no exports 00000020:00000080:0.0:1790971826.478366:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f492c0 00000020:00000080:0.0:1790971826.478376:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd488a9c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790971826.478999:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4b7043800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1790971826.485684:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd488a9c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790971826.488423:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790971826.488448:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790971826.488454:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4bd891800/lustre-QMT0000_UUID 00000020:00000080:0.0:1790971826.488459:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4bd891800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790971826.488504:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1790971827.300648:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971827.559053:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766269696:0@lo:400:kworker.0 00000100:00100000:2.0:1790971827.559128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971827.559267:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766269952:0@lo:400:kworker.0 00000100:00100000:1.0:1790971827.559298:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971827.559324:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971827.559330:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766269824:0@lo:400:kworker.0 00000100:00100000:1.0:1790971827.559355:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971827.559449:0:5831:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269696 00000100:00100000:0.0:1790971827.559457:0:5831:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269696 00000100:00100000:0.0:1790971827.559534:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1790971827.559543:0:5831:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3305:x1877969766269696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971827.563906:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269952 00000100:00100000:1.0:1790971827.563922:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269952 00000100:00100000:1.0:1790971827.564021:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766269824 00000100:00100000:1.0:1790971827.564025:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766269824 00000100:00100000:1.0:1790971827.564044:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790971827.564051:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877969766269952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790971827.564060:0:5840:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790971827.564142:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877969766269952:12345-0@lo:400:kworker.0 Request processed in 90us (4843us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790971827.564149:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790971827.564163:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790971827.564179:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877969766269824:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790971827.564184:0:5840:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790971827.564205:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1877969766269824:12345-0@lo:400:kworker.0 Request processed in 25us (4849us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790971827.564210:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1790971827.564258:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790971827.564263:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8cd385017800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790971827.564268:0:3303:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1790971827.564970:0:5831:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd488389450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0404db5-d37b-41bb-8054-1f8859117a4f+14:3305:x1877969766269696:12345-0@lo:400:kworker.0 Request processed in 5422us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971827.564978:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766269696:0@lo:400:kworker.0 00000100:00100000:0.0:1790971827.564984:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:1.0:1790971827.574795:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8cd385017800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790971827.574807:0:3303:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 194 00000100:00080000:1.0:1790971827.574823:0:3303:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cd385017800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971827.574864:0:3303:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4a66b4380 x1877969766270080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790971827.574900:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1877969766269824:0@lo:400:kworker.0 00000100:00080000:1.0:1790971827.574932:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790971827.574936:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8cd386fac800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790971827.574939:0:3303:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790971827.574942:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8cd386fac800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790971827.574945:0:3303:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 213 00000100:00080000:1.0:1790971827.574949:0:3303:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cd386fac800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971827.574962:0:3303:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4a66b4e00 x1877969766270208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790971827.574971:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1877969766269952:0@lo:400:kworker.0 00000100:00100000:3.0:1790971827.575131:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766270080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1790971827.575192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971827.575223:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766270208:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1790971827.575250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971827.575322:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766270080 00000100:00100000:1.0:1790971827.575329:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766270080 00000100:00100000:1.0:1790971827.575365:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766270208 00000100:00100000:1.0:1790971827.575367:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766270208 00000100:00100000:1.0:1790971827.575387:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790971827.575393:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877969766270080:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1790971827.575408:0:5840:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790971827.577423:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877969766270080:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2019us (2221us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790971827.577435:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790971827.577487:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790971827.577493:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c02ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877969766270208:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1790971827.577507:0:5840:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790971827.577533:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c02ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877969766270208:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 40us (2283us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790971827.577539:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1790971827.578130:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd385017800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790971827.578136:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790971827.578140:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766270080:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1790971827.578151:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd386fac800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790971827.578155:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790971827.578157:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766270208:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1790971828.325186:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790971828.608927:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790971828.608936:0:7646:0:(genops.c:885:class_export_put()) final put ffff8cd4be191800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790971828.608963:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be191800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790971828.609008:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4be191000 for lustre-OST0001 00000001:00100000:1.0:1790971828.653537:0:5861:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be25fcca-2306-4aa1-b74f-3903af7f4a28 00000001:00080000:1.0:1790971828.653561:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1790971828.653570:0:5861:0:(genops.c:885:class_export_put()) final put ffff8cd4be09b800/be25fcca-2306-4aa1-b74f-3903af7f4a28 00000020:00000080:2.0:1790971828.653715:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be09b800/be25fcca-2306-4aa1-b74f-3903af7f4a28 for lustre-MDT0000 00000020:00000080:2.0:1790971828.653781:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4be098000 for lustre-MDT0000 00010000:00010000:2.0:1790971829.348871:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971830.372822:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790971831.187568:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790971831.187576:0:6714:0:(genops.c:885:class_export_put()) final put ffff8cd384dec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790971831.187656:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd384dec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790971831.187781:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd384ded000 for lustre-OST0000 00010000:00010000:0.0:1790971831.396814:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971832.420685:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790971832.548613:0:13020:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd4c00e37e0 - data ffff8cd4c1c4fd80/ffff8cd3859e9400 00000020:01000000:0.0:1790971832.548948:0:13020:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd4886e3000 - data ffff8cd49b8115e8/ffff8cd4be2f8800 00000001:00000004:0.0:1790971832.559874:0:13020:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1790971832.616361:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790971832.616369:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790971832.616391:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790971832.616394:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790971832.617342:0:7003:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790971832.617348:0:7003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1790971832.617356:0:7003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790971832.618621:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790971832.618626:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1790971832.618678:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790971832.618681:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790971832.619286:0:8040:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790971832.619291:0:8040:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1790971832.619299:0:8040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790971832.662435:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f4928f 00000020:00000080:3.0:1790971832.662448:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4833f3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790971832.662777:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4833f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790971832.663924:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f492a4 00000020:00000080:3.0:1790971832.663932:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4be52d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790971832.663982:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790971832.663988:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790971832.663996:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790971832.664001:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8cd495690000) has no exports 00000004:01000000:3.0:1790971832.664146:0:13020:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790971832.664154:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f494e2 00000020:00000080:3.0:1790971832.664158:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4be197800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790971832.664193:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be52d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790971832.664269:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790971832.664273:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790971832.664279:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790971832.664281:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8cd4be040000) has no exports 00000020:00000080:3.0:1790971832.664294:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f494db 00000020:00000080:3.0:1790971832.664298:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4883e9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790971832.664317:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be197800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1790971832.664767:0:13020:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790971832.664772:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790971832.664776:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1790971832.664781:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790971832.664784:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790971832.664914:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4883e9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790971832.664993:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790971832.665001:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790971832.665007:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f493fb 00000020:00000080:3.0:1790971832.665012:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd385011000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790971832.665034:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4883e9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790971832.665040:0:8:0:(genops.c:885:class_export_put()) final put ffff8cd386fac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790971832.665042:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd386fac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790971832.665053:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790971832.665162:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790971832.665167:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790971832.665172:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790971832.665175:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8cd4882499c0) has no exports 00000020:00000080:3.0:1790971832.665179:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f493f4 00000020:00000080:3.0:1790971832.665183:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd387492800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790971832.665200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd385011000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1790971832.665668:0:13020:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790971832.665682:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790971832.665685:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1790971832.665690:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790971832.665692:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790971832.665789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd387492800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790971832.665904:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790971832.665912:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790971832.665939:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790971832.665942:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790971832.665945:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4bd8cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790971832.665947:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4bd8cd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790971832.665952:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790971832.666077:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f492ab 00000020:00000080:3.0:1790971832.666082:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4be52f000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790971832.666119:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd387494800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790971832.666126:0:8:0:(genops.c:885:class_export_put()) final put ffff8cd4c1a43000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790971832.666128:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4c1a43000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790971832.666134:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790971832.666328:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1790971832.666333:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790971832.666338:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790971832.666341:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8cd495693380) has no exports 00000020:00000080:3.0:1790971832.666363:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790971832.666366:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1790971832.666369:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f492b2 00000020:00000080:3.0:1790971832.666373:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4be52f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790971832.666402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be52f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790971832.666406:0:8:0:(genops.c:885:class_export_put()) final put ffff8cd4be52a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790971832.666408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be52a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790971832.666413:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1790971832.666933:0:13020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4b52bc800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1790971832.666938:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4b52bc800 3 00000020:01000004:3.0:1790971832.666940:0:13020:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cd4b52bc800 from lustre-MDT0000 00000020:00000080:3.0:1790971832.666962:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790971832.666966:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1790971832.666968:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4bd8cb000/lustre-MDT0000_UUID 00000020:00000080:3.0:1790971832.666970:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4bd8cb000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1790971832.666976:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1790971832.667002:0:13020:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1790971832.667005:0:13020:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1790971832.667007:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1790971832.667010:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790971832.667012:0:13020:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790971832.667017:0:13020:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8cd496240000 a0404db5-d37b-41bb-8054-1f8859117a4f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790971832.667022:0:13020:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8cd48824b380) has exports, disconnecting them 00000020:00080000:3.0:1790971832.667025:0:13020:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cd496240000), last request at 1790971596 00000020:00000080:3.0:1790971832.667037:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49249 00000020:00010000:3.0:1790971832.667040:0:13020:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cd496240000: total 1 00000100:00080000:3.0:1790971832.667044:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8cd4b52bb000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790971832.667063:0:13020:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cd496240000): rc 0 00000020:00080000:3.0:1790971832.667066:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8cd48824b380) has no exports 00000020:00010000:2.0:1790971832.667152:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cd496240000: total 1 00010000:00010000:2.0:1790971832.667178:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cd496240000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1790971832.667201:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d58400/0xbd3388eaa6f49552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f4954b expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667218:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd487d58200/0xbd3388eaa6f49560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f49559 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667227:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbd200/0xbd3388eaa6f4956e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f49567 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667236:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd49bcbc000/0xbd3388eaa6f4957c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f49575 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667244:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd43a00/0xbd3388eaa6f497a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f4979e expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667252:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f497b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f497ac expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667263:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494934e00/0xbd3388eaa6f49368 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f49361 expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667272:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4afd43000/0xbd3388eaa6f495a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd3388eaa6f4959f expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971832.667280:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cd496240000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1790971832.667297:0:5827:0:(genops.c:885:class_export_put()) final put ffff8cd496240000/a0404db5-d37b-41bb-8054-1f8859117a4f 00000020:00000080:1.0:1790971832.667322:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4be52f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1790971832.667372:0:5831:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cd4886fb600:5831] 0 exiting: rc = 1 00010000:00010000:2.0:1790971832.667378:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971832.667380:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971832.667382:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971832.667401:0:5832:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cd495784000:5832] 1 exiting: rc = 0 00000020:00000080:1.0:1790971832.667434:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd496240000/a0404db5-d37b-41bb-8054-1f8859117a4f for MGS 00000100:00100000:0.0:1790971832.667452:0:5834:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cd4886fa400:5834] 2 exiting: rc = 0 00000020:00000080:1.0:1790971832.667466:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd4b52bb000 for MGS 00000100:00100000:0.0:1790971832.667662:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667668:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667673:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667754:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667759:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667764:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667769:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667780:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667785:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667790:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667794:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667800:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667808:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667813:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667819:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667823:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667828:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667833:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667838:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667843:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667848:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667852:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667857:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667862:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667866:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667870:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667875:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667879:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667883:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667887:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667891:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667895:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667899:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667904:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667907:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667912:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667915:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667919:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667923:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667928:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667932:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667937:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667945:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667950:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667954:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667960:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667965:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667972:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667976:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667981:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667986:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667991:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.667996:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668000:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668005:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668010:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668015:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668020:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668025:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668029:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668034:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668038:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668042:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971832.668046:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1790971832.668387:0:13020:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790971832.668391:0:13020:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1790971832.669583:0:13020:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd4bdd13540 - data ffff8cd4b4bc6af8/ffff8cd3859ee800 00000020:01000000:1.0:1790971832.669729:0:13020:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd488ae6360 - data ffff8cd49b86b360/ffff8cd488757c00 00000020:00000080:1.0:1790971832.670167:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49234 00000020:00000080:1.0:1790971832.670174:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd496242000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790971832.670186:0:13020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4b52bc800 from MGS, refs=2 00000020:01000004:1.0:1790971832.670190:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4b52bc800 2 00000020:01000004:1.0:1790971832.670193:0:13020:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cd4b52bc800 from MGS 00000020:00000080:1.0:1790971832.670210:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790971832.670216:0:13020:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790971832.670219:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd48a930000/MGS 00000020:00000080:1.0:1790971832.670222:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd48a930000/MGS for MGS 00000020:01000000:1.0:1790971832.670227:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790971832.670271:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790971832.670274:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790971832.670280:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790971832.670286:0:13020:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cd494dd0800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790971832.670291:0:13020:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8cd48824cd40) has exports, disconnecting them 00000020:00080000:1.0:1790971832.670295:0:13020:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cd494dd0800), last request at 1790971597 00000020:00000080:1.0:1790971832.670299:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f492ff 00000020:00080000:1.0:1790971832.670306:0:13020:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cd494dd0800): rc 0 00000020:00000080:1.0:1790971832.670310:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd494dd0800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790971832.671791:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd496242000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790971832.671803:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd494dd0800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1790971832.674541:0:13020:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1790971832.674549:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790971832.674553:0:13020:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790971832.674560:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790971832.674742:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790971832.674752:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1790971832.674758:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4b52bc800 1 00000020:00000080:2.0:1790971832.674764:0:13020:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49226 00000020:00000080:2.0:1790971832.674772:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd48842d800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1790971832.674776:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1790971832.674782:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790971832.674786:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790971832.674789:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8cd495694d40) has no exports 00000020:00000080:3.0:1790971832.674925:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd494dd5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790971832.674933:0:38:0:(genops.c:885:class_export_put()) final put ffff8cd494dd2800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790971832.674935:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd494dd2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790971832.674952:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790971832.675006:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd48842d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1790971832.677313:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd488bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766270336:0@lo:400:kworker.0 00000400:00000100:2.0:1790971832.677366:0:3304:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877969766270336 offset 0 length 224: 4 00000100:00080000:3.0:1790971832.677428:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790971832.677434:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790971832.677438:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cd385017800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790971832.677443:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1790971832.677448:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790971832.677457:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cd385017800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1790971832.677498:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd495773800 x1877969766270464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790971832.677514:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790971832.677517:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790971832.677519:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cd386fac800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790971832.677522:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1790971832.677524:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790971832.677528:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cd386fac800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1790971832.677539:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4bdf13b80 x1877969766270592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790971832.677563:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766270464:0@lo:38:kworker.0 00000100:00100000:3.0:1790971832.677603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971832.677625:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766270592:0@lo:38:kworker.0 00000100:00100000:3.0:1790971832.677646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971832.677819:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766270464 00000100:00100000:3.0:1790971832.677828:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766270464 00000100:00100000:3.0:1790971832.677863:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766270592 00000100:00100000:3.0:1790971832.677877:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766270592 00000100:00100000:3.0:1790971832.677898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1790971832.677905:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1877969766270464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790971832.677922:0:5839:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790971832.677963:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1877969766270464:12345-0@lo:38:kworker.0 Request processed in 57us (360us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790971832.677970:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1790971832.677986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1790971832.677991:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1877969766270592:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790971832.677999:0:5839:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790971832.678023:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1877969766270592:12345-0@lo:38:kworker.0 Request processed in 31us (376us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790971832.678029:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1790971832.678062:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd385017800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790971832.678067:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790971832.678070:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766270464:0@lo:38:kworker.0 00000100:00080000:3.0:1790971832.678079:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd386fac800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790971832.678082:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790971832.678085:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766270592:0@lo:38:kworker.0 00000020:00000080:3.0:1790971832.712024:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790971832.712037:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790971832.712043:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd4b52ba000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790971832.712047:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4b52ba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790971832.712057:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790971832.712178:0:13020:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cd4b52ba800 00000020:01000000:3.0:1790971832.712199:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1790971832.712212:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790971832.712216:0:13020:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790971832.712220:0:13020:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8cd487948000) has no exports 00000100:00100000:3.0:1790971832.712305:0:5839:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff8cd48784ac00:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1790971832.712436:0:5838:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff8cd487849c00:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1790971832.712508:0:5840:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff8cd487848200:5840] 2 exiting: rc = 0 00000100:00100000:3.0:1790971832.712759:0:7888:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff8cd384ff7400:7888] 3 exiting: rc = 0 00000100:00100000:2.0:1790971832.713151:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713158:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713164:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713169:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713174:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713179:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713195:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713202:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713212:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713220:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713228:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713237:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713246:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713254:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713263:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713274:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713282:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713292:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713300:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713311:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713320:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713330:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713339:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713348:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713357:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713365:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713375:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713382:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713392:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713401:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713409:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713417:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713427:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713436:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713444:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713452:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.713461:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716776:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716857:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716866:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716873:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716906:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716913:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716921:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716929:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716935:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716942:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716972:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716981:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716987:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716992:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.716997:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717005:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717011:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717016:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717021:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717026:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717031:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717036:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717042:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717049:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717056:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717063:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.717071:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.721829:0:5842:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cd487848400:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1790971832.721975:0:5841:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cd487849600:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1790971832.722074:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722082:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722090:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722102:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722109:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722115:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722122:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722128:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722133:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722139:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722144:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722161:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722167:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722172:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722177:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722182:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722187:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722192:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722197:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722202:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722207:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722212:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722217:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722221:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722227:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722232:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722237:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722242:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722246:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722251:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722255:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722260:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722265:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722269:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722274:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722280:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722284:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722289:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722294:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722299:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722304:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722309:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722314:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722319:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722324:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722328:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722342:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722347:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722352:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722357:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722361:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722366:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722371:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722375:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722380:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722385:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722390:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722395:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722400:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722405:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722410:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722416:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722421:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.722435:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790971832.725105:0:5843:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff8cd48298f000:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1790971832.727447:0:5844:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff8cd48298e200:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1790971832.727647:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727656:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727682:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727690:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727696:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727702:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727710:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727732:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727740:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727746:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727752:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727758:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727764:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727770:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727776:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727782:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727788:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727806:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727814:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727840:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727847:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727852:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727859:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727866:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727871:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727879:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727885:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727891:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727896:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727903:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727909:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727928:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727934:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727941:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727948:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727953:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727958:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727963:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727969:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727974:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727981:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727987:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.727993:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728013:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728019:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728024:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728030:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728035:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728040:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728045:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728051:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728056:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728069:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728076:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728083:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728101:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728108:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728113:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728120:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728126:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728132:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728138:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728144:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.728159:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790971832.736139:0:5845:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cd48298e400:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1790971832.736283:0:5846:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cd48557b000:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1790971832.736382:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736389:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736394:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736400:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736405:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736410:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736416:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736421:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736425:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736429:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736434:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736439:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736444:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736448:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736453:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736457:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736462:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736563:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736572:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736576:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736581:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736586:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736591:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736605:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736610:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736615:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736619:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736623:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736628:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736632:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736637:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736641:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736645:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736651:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736656:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736660:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736666:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736672:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736755:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736760:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736765:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736770:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736776:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736781:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736785:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736790:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736794:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736799:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736803:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736807:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736811:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736816:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736820:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736824:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736829:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736833:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736837:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736842:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736854:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736859:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736863:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736868:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736872:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.736877:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.737935:0:5848:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cd4957c2200:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1790971832.738028:0:5847:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cd4957c3a00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1790971832.738389:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738396:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738401:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738406:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738411:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738416:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738421:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738425:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738430:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738434:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738440:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738444:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738449:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738455:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738459:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738464:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738499:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738506:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738511:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738516:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738521:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738526:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738532:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738537:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738542:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738547:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738552:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738557:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738562:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738576:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738582:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738587:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738592:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738596:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738603:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738607:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738612:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738617:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738622:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738628:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738634:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738639:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738645:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738650:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738655:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738660:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738666:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738671:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738819:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738824:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738829:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738833:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738837:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738842:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738847:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738851:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738856:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738860:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738865:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738870:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738874:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738879:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738884:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.738888:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790971832.739490:0:5849:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cd487e2f000:5849] 0 exiting: rc = 1 00000100:00100000:2.0:1790971832.739780:0:5850:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cd495b49e00:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1790971832.740104:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740110:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740115:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740120:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740125:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740130:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740135:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740140:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740145:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740149:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740153:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740158:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740163:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740168:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740174:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740178:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740183:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740187:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740193:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740198:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740203:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740207:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740212:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740217:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740222:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740235:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740240:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740245:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740249:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740254:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740259:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740263:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740267:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740272:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740278:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740283:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740289:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740294:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740299:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740304:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740309:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740314:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740772:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740779:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740784:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740789:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740793:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740798:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740803:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740807:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740812:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740816:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740821:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740826:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740831:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740835:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740839:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740844:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740848:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740853:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740865:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740869:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740875:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.740879:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971832.741460:0:5851:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff8cd487ee0c00:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1790971832.741730:0:5853:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff8cd487ee1a00:5853] 2 exiting: rc = 0 00000100:00100000:1.0:1790971832.742210:0:5852:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff8cd487ee0800:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1790971832.742639:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742646:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742651:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742657:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742662:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742668:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742683:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742690:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742696:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742701:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742706:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742711:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742724:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742731:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742736:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742741:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742747:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742765:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742772:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742778:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742783:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742790:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742796:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742800:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742805:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742812:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742817:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742822:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742827:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742833:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742848:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742853:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742858:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742863:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742868:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742873:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742878:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742905:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742911:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742916:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742921:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742941:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742948:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742953:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742958:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742963:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742969:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742974:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742979:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742984:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742990:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.742995:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743001:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743006:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743011:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743016:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743021:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743027:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743032:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743038:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743043:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743048:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743053:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971832.743058:0:13020:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790971832.747182:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790971832.747194:0:13020:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790971832.747198:0:13020:0:(genops.c:885:class_export_put()) final put ffff8cd487939800/MDS_uuid 00000020:00000080:2.0:1790971832.747202:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd487939800/MDS_uuid for MDS 00000020:01000000:2.0:1790971832.747208:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790971832.747336:0:13020:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1790971833.450051:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971834.468693:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790971835.371239:0:13174:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790971835.390617:0:13174:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790971835.390664:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.390679:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.390686:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.390693:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.390727:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790971835.390733:0:13174:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790971835.390755:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790971835.390759:0:13174:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790971835.390765:0:13174:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790971835.390771:0:13174:0:(import.c:65:import_set_state_nolock()) ffff8cd385017800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790971835.390775:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790971835.390777:0:13174:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790971835.390793:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790971835.391580:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971835.391597:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971835.391605:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002da00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971835.391609:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971835.391617:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971835.391623:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971835.391628:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790971835.391631:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790971835.391633:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790971835.391667:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971835.391674:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790971835.391741:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766270720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790971835.391810:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971835.391891:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971835.391899:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f49567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4956e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971835.391912:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971835.391914:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971835.391916:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971835.392244:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392252:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392259:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392265:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392287:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971835.392294:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392301:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392307:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392313:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392324:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790971835.392328:0:13174:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790971835.392344:0:13174:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790971835.392348:0:13174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1790971835.392359:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790971835.392372:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392378:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d59600 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971835.392380:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392387:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971835.392393:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971835.392398:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790971835.392400:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790971835.392401:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790971835.392418:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392424:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971835.392437:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392443:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd487d59600/0xbd3388eaa6f49575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f4957c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392456:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971835.392459:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392465:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002dc00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971835.392500:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392507:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971835.392513:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971835.392518:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790971835.392520:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790971835.392522:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790971835.392537:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392543:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971835.392550:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392556:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002dc00/0xbd3388eaa6f497ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd3388eaa6f497b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971835.392565:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971835.392567:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971835.392569:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790971835.392582:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790971835.392590:0:13174:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790971835.392593:0:13174:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cd4be2a0000) has no exports 00000020:00080000:2.0:1790971835.392616:0:13174:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cd4be2a0000) has no exports 00000100:00100000:1.0:1790971835.393409:0:5824:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766270720 00000100:00100000:1.0:1790971835.393419:0:5824:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766270720 00000100:00100000:1.0:1790971835.393458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790971835.393466:0:5824:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1877969766270720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790971835.393542:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790971835 with bad export cookie 13633391038385394249 00010000:00010000:3.0:1790971835.395390:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971835.395418:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766270848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971835.395519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971835.395566:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790971835.395573:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766270976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971835.395602:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971835.395634:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766270848 00000100:00100000:3.0:1790971835.395641:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766270848 00000100:00100000:3.0:1790971835.395664:0:5825:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766270976 00000100:00100000:3.0:1790971835.395666:0:5825:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766270976 00000100:00100000:3.0:1790971835.395678:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790971835.395684:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1877969766270848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790971835.395690:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790971835 with bad export cookie 13633391038385394249 00000100:00100000:3.0:1790971835.395745:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1877969766270848:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (226us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790971835.395751:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790971835.395767:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790971835.395771:0:5825:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4886c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1877969766270976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790971835.395775:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790971835 with bad export cookie 13633391038385394249 00000100:00100000:3.0:1790971835.395799:0:5825:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4886c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1877969766270976:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (197us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790971835.395804:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1790971835.396750:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790971835.396755:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cd48793f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1790971835.396759:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1790971835.401075:0:13174:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd4bdd13720 - data ffff8cd4c1c74360/ffff8cd3859ed000 00000020:01000000:2.0:1790971835.401335:0:13174:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd488ae7d20 - data ffff8cd384955000/ffff8cd384df2400 00000100:00080000:3.0:1790971835.424386:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.143@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1790971835.424392:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790971835.424401:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cd488bc0000 x1877969766270336/t0(0) o400->MGC192.168.203.143@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790971848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971835.424452:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cd495acc700 x1877969766270720/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790971851 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971835.424464:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cd4bdda0a80 x1877969766270848/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790971851 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971835.424503:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cd4bdda3800 x1877969766270976/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790971851 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790971835.424513:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790971835.424516:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790971835.424518:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790971835.424522:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cd48793f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790971835.424527:0:3302:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 175 00000100:00080000:3.0:1790971835.424541:0:3302:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff8cd48793f000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1790971835.424553:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd488bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0404db5-d37b-41bb-8054-1f8859117a4f:3304:1877969766270336:0@lo:400:kworker.0 00000100:00100000:0.0:1790971835.425235:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0404db5-d37b-41bb-8054-1f8859117a4f:3305:1877969766270720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790971835.428801:0:3302:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd38518c700 x1877969766271104/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790971835.428856:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766270848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790971835.428878:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0404db5-d37b-41bb-8054-1f8859117a4f:3302:1877969766270976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790971835.428882:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0404db5-d37b-41bb-8054-1f8859117a4f:3301:1877969766271104:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1790971835.428927:0:3301:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877969766271104 offset 0 length 520: 4 00000400:00000100:0.0:1790971835.432388:0:5824:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1877969766270720 offset 224 length 224: 4 00000100:00100000:0.0:1790971835.432413:0:5824:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1877969766270720:12345-0@lo:103:ldlm_bl.0 Request processed in 38946us (40603us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790971835.432427:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00100000:10000000:0.0:1790971835.446084:0:13174:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790971835.476732:0:13174:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49384 00000020:00000080:2.0:1790971835.476743:0:13174:0:(genops.c:885:class_export_put()) final put ffff8cd384deb000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790971835.476764:0:13174:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4be529000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790971835.476767:0:13174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4be529000 2 00000020:01000004:2.0:1790971835.476770:0:13174:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cd4be529000 from lustre-OST0000 00000020:00000080:2.0:1790971835.476794:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790971835.476803:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790971835.476805:0:13174:0:(genops.c:885:class_export_put()) final put ffff8cd384de8000/lustre-OST0000_UUID 00000020:00000080:2.0:1790971835.476808:0:13174:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd384de8000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790971835.476815:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790971835.476851:0:13174:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790971835.476854:0:13174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790971835.476858:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790971835.476862:0:13174:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790971835.476868:0:13174:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cd385016800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790971835.476874:0:13174:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8cd49fdd19c0) has exports, disconnecting them 00000020:00080000:2.0:1790971835.476879:0:13174:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cd385016800), last request at 1790971615 00000020:00000080:2.0:1790971835.476882:0:13174:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f493ae 00000020:00080000:2.0:1790971835.476891:0:13174:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cd385016800): rc 0 00000020:00000080:2.0:1790971835.476894:0:13174:0:(genops.c:885:class_export_put()) final put ffff8cd385016800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790971835.477569:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd384deb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790971835.477583:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd385016800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1790971835.481533:0:13174:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790971835.481541:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790971835.481545:0:13174:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790971835.481552:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790971835.481758:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790971835.481768:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1790971835.481774:0:13174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4be529000 1 00000020:00000080:0.0:1790971835.481781:0:13174:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f4933e 00000020:00000080:0.0:1790971835.481789:0:13174:0:(genops.c:885:class_export_put()) final put ffff8cd4c01c8800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790971835.481794:0:13174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790971835.481799:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790971835.481803:0:13174:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790971835.481806:0:13174:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8cd4be2a4d40) has no exports 00000020:00000080:1.0:1790971835.482315:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd385017800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790971835.482322:0:38:0:(genops.c:885:class_export_put()) final put ffff8cd4bfbb0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790971835.482325:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4bfbb0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790971835.482333:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790971835.482381:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4c01c8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790971835.496296:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790971835.496312:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1790971835.496317:0:13174:0:(genops.c:885:class_export_put()) final put ffff8cd488a9b800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1790971835.496322:0:13174:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd488a9b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1790971835.496328:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1790971835.496455:0:13174:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cd4be52b800 00000020:02000400:0.0:1790971835.496511:0:13174:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1790971835.518912:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971836.518063:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971837.542628:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790971837.749202:0:13323:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790971837.764615:0:13323:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790971837.764727:0:13323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.764742:0:13323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.764750:0:13323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.764770:0:13323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.764792:0:13323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790971837.764798:0:13323:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790971837.764822:0:13323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790971837.764827:0:13323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790971837.764832:0:13323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790971837.764842:0:13323:0:(import.c:65:import_set_state_nolock()) ffff8cd386fac800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790971837.764847:0:13323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790971837.764849:0:13323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790971837.764852:0:13323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790971837.765731:0:13323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765743:0:13323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765750:0:13323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765757:0:13323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765775:0:13323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790971837.765782:0:13323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765802:0:13323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765809:0:13323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765815:0:13323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971837.765827:0:13323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1790971837.765830:0:13323:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790971837.765849:0:13323:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790971837.765854:0:13323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790971837.765858:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790971837.765863:0:13323:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790971837.765867:0:13323:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cd4879499c0) has no exports 00000020:00080000:2.0:1790971837.765889:0:13323:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cd4879499c0) has no exports 00010000:00010000:3.0:1790971837.766135:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790971837.766143:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766150:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd49bcbd800 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971837.766153:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766161:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971837.766169:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971837.766183:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790971837.766185:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790971837.766187:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790971837.766199:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cd48793f000 00010000:00010000:3.0:1790971837.766203:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766213:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbd800/0xbd3388eaa6f4954b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f49552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766225:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790971837.766229:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766235:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42200 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971837.766238:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766244:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971837.766250:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971837.766256:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790971837.766257:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1790971837.766259:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1790971837.766264:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cd48793f000 00010000:00010000:3.0:1790971837.766267:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766280:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42200/0xbd3388eaa6f49559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f49560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766290:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971837.766293:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766299:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f600 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:3.0:1790971837.766302:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766310:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790971837.766316:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971837.766321:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790971837.766323:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790971837.766325:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790971837.766331:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cd48793f000 00010000:00010000:3.0:1790971837.766333:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766339:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f600/0xbd3388eaa6f4979e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f497a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971837.766351:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971837.766353:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971837.766360:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971837.766368:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971837.766622:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790971837.769655:0:13323:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd4b278e1e0 - data ffff8cd4c1cf2510/ffff8cd384d40c00 00000020:01000000:3.0:1790971837.770181:0:13323:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff8cd4bdd13d80 - data ffff8cd49b84bca8/ffff8cd4b7091800 00100000:10000000:2.0:1790971837.795569:0:13323:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000100:00080000:1.0:1790971837.798928:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0404db5-d37b-41bb-8054-1f8859117a4f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790971837.798939:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a0404db5-d37b-41bb-8054-1f8859117a4f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:0.0:1790971837.821129:0:13323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f4944f 00000020:00000080:0.0:1790971837.821139:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd387494000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790971837.821351:0:13323:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4bfbb1000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790971837.821365:0:13323:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4bfbb1000 2 00000020:01000004:0.0:1790971837.821369:0:13323:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cd4bfbb1000 from lustre-OST0001 00000020:00000080:0.0:1790971837.821391:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790971837.821400:0:13323:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790971837.821403:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd387496800/lustre-OST0001_UUID 00000020:00000080:0.0:1790971837.821406:0:13323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd387496800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790971837.821412:0:13323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790971837.821548:0:13323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a0404db5-d37b-41bb-8054-1f8859117a4f->MGS 00010000:00010000:0.0:1790971837.821564:0:13323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f49368 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971837.821576:0:13323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f49368 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971837.821582:0:13323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790971837.821584:0:13323:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790971837.821587:0:13323:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790971837.821600:0:13323:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cd48793f000 00010000:00010000:0.0:1790971837.821603:0:13323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4afd42e00/0xbd3388eaa6f49361 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f49368 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971837.821619:0:13323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd3388eaa6f495a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971837.821626:0:13323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd3388eaa6f495a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971837.821631:0:13323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790971837.821633:0:13323:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790971837.821799:0:13323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790971837.821811:0:13323:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cd48793f000 00010000:00010000:0.0:1790971837.821814:0:13323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd49bcbc800/0xbd3388eaa6f4959f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd3388eaa6f495a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790971837.821838:0:13323:0:(import.c:65:import_set_state_nolock()) ffff8cd48793f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790971837.821842:0:13323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790971837.821844:0:13323:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790971837.821846:0:13323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790971837.821850:0:13323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790971837.821860:0:13323:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cd38518c700 x1877969766271104/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790971845 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790971837.821917:0:13323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790971837.821920:0:13323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000020:00000080:1.0:1790971837.821971:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd387494000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1790971837.822554:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0404db5-d37b-41bb-8054-1f8859117a4f:3301:1877969766271104:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1790971837.822625:0:13323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790971837.822633:0:13323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49242 00000020:00000080:0.0:1790971837.822639:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd48793f800/a0404db5-d37b-41bb-8054-1f8859117a4f 00000020:01000000:0.0:1790971837.822653:0:13323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.143@tcp (flags='') 00000020:00000080:0.0:1790971837.822658:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790971837.822663:0:13323:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790971837.822667:0:13323:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8cd48794cd40) has no exports 00000020:00000080:1.0:1790971837.822740:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd48793f800/a0404db5-d37b-41bb-8054-1f8859117a4f for MGC192.168.203.143@tcp 10000000:01000000:3.0:1790971837.823594:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790971837.825795:0:13323:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.143@tcp: client import never connected 00000100:00080000:1.0:1790971837.825803:0:13323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790971837.825807:0:13323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790971837.825811:0:13323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790971837.825813:0:13323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790971837.825914:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790971837.825923:0:13323:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.143@tcp (uuid a0404db5-d37b-41bb-8054-1f8859117a4f) 00000020:01000000:1.0:1790971837.825933:0:13323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790971837.825942:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790971837.825947:0:13323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790971837.825968:0:13323:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cd386faa000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790971837.825975:0:13323:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8cd48794b380) has exports, disconnecting them 00000020:00080000:1.0:1790971837.825979:0:13323:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cd386faa000), last request at 1790971634 00000020:00000080:1.0:1790971837.825984:0:13323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f49479 00000020:00080000:1.0:1790971837.825998:0:13323:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cd386faa000): rc 0 00000020:00000080:1.0:1790971837.826004:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd386faa000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1790971837.826760:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd48793f000 for MGC192.168.203.143@tcp 00000020:00000080:3.0:1790971837.826769:0:38:0:(genops.c:885:class_export_put()) final put ffff8cd487939000/a0404db5-d37b-41bb-8054-1f8859117a4f 00000020:00000080:3.0:1790971837.826773:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd487939000/a0404db5-d37b-41bb-8054-1f8859117a4f for MGC192.168.203.143@tcp 00000020:01000000:3.0:1790971837.826781:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.143@tcp (a0404db5-d37b-41bb-8054-1f8859117a4f) 00000020:00000080:3.0:1790971837.827218:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd386faa000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790971837.832586:0:13323:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790971837.832595:0:13323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790971837.832599:0:13323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790971837.832607:0:13323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790971837.832656:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cd386fac800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1790971837.832677:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1790971837.832797:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790971837.856741:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1790971837.856899:0:5823:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cd495792000:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1790971837.857636:0:5822:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cd495793400:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1790971837.857775:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858002:0:5824:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cd4a6740600:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1790971837.858335:0:5825:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cd4a6740400:5825] 1 exiting: rc = 0 00000100:00100000:3.0:1790971837.858381:0:5826:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cd495793200:5826] 2 exiting: rc = 0 00000100:00100000:3.0:1790971837.858425:0:7634:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cd4b287fa00:7634] 3 exiting: rc = 0 00000100:00100000:0.0:1790971837.858796:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858806:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858813:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858820:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858825:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858830:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858835:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858841:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858846:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858866:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858872:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858879:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858885:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858891:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858897:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858903:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858909:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858915:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858920:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858926:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858930:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858935:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858941:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.858947:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859523:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859528:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859534:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859539:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859546:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859551:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859555:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859561:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859566:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859571:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859576:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859581:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859594:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859605:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859610:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859614:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859619:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859624:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859629:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859633:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859646:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859652:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859658:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859663:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859670:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859675:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859691:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859697:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859708:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859713:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859718:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859722:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859727:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859731:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859736:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859740:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859744:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859748:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859753:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.859757:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790971837.861030:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790971837.861049:0:13323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1790971837.861319:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd386fae800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1790971837.861325:0:13323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd386fae800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1790971837.861331:0:13323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1790971837.861378:0:13323:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4bfbb1000 1 00000020:00000080:0.0:1790971837.861384:0:13323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xbd3388eaa6f4941e 00000020:00000080:0.0:1790971837.861390:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd4c1a44000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1790971837.861409:0:13323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1790971837.861414:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790971837.861419:0:13323:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790971837.861422:0:13323:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8cd49fdd3380) has no exports 00000020:00000080:3.0:1790971837.861582:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4c1a44000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790971837.895303:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790971837.895609:0:13323:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1790971837.895625:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd4bfbb2800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1790971837.895630:0:13323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4bfbb2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1790971837.895749:0:13323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1790971837.895926:0:13323:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cd4bfbb1800 00000020:01000000:0.0:1790971837.895948:0:13323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1790971837.895953:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790971837.896389:0:13323:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790971837.896395:0:13323:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8cd488248000) has no exports 00000020:00000080:0.0:1790971837.896741:0:13323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790971837.896751:0:13323:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1790971837.896755:0:13323:0:(genops.c:885:class_export_put()) final put ffff8cd4c01cf800/OSS_uuid 00000020:00000080:0.0:1790971837.896758:0:13323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cd4c01cf800/OSS_uuid for OSS 00000020:01000000:0.0:1790971837.896762:0:13323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1790971837.896891:0:6689:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff8cd4b2749600:6689] 0 exiting: rc = 1 00000100:00080000:3.0:1790971837.897673:0:5835:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790971837.897850:0:6690:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff8cd4b2748200:6690] 1 exiting: rc = 0 00000100:00100000:2.0:1790971837.897937:0:6691:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff8cd495792600:6691] 2 exiting: rc = 0 00000100:00100000:0.0:1790971837.898011:0:8047:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff8cd4a05afa00:8047] 3 exiting: rc = 0 00000100:00100000:3.0:1790971837.898092:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898109:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898120:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898129:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898134:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898139:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898144:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898150:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898155:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898160:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898165:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898180:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898185:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898191:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898197:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898202:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898212:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898218:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898223:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898229:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898236:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898242:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898249:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898257:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898264:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898269:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898279:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898286:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898291:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898296:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898301:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898305:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898310:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898316:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898334:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898341:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898345:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898351:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898356:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898361:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898366:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898371:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898376:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898382:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898387:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898392:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898405:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898410:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898415:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898421:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898426:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898432:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898437:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898443:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898448:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898453:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898458:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898464:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898494:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898501:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898506:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898511:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898517:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.898522:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.901256:0:6692:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cd4afd36600:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1790971837.901377:0:6693:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cd4afd37600:6693] 1 exiting: rc = 0 00000100:00100000:3.0:1790971837.901814:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901826:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901832:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901837:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901842:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901846:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901851:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901856:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901861:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901866:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901872:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901877:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901881:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901887:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901893:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901899:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901906:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901930:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901938:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901946:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901953:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901960:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901968:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901977:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901986:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.901996:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902003:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902011:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902019:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902025:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902037:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902045:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902052:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902059:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902067:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902075:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902085:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902092:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902099:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902106:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902112:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902117:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902127:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902133:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902137:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902141:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902146:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902151:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902155:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902159:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902164:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902168:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902184:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902189:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902194:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902199:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902204:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902210:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902214:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902219:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902224:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902229:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902233:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.902239:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790971837.904453:0:6694:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cd4affd9600:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1790971837.905905:0:6696:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cd4afd37000:6696] 2 exiting: rc = 0 00000100:00100000:0.0:1790971837.908786:0:6695:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cd4afd37e00:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1790971837.908878:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908890:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908898:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908911:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908921:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908931:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908949:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908957:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.908995:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909009:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909016:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909022:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909028:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909034:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909038:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909043:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909049:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909055:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909061:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909066:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909071:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909077:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909095:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909100:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909106:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909111:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909116:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909121:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909127:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909133:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909138:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909144:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909165:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909172:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909177:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909182:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909186:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909191:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909198:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909203:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909210:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909215:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909221:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909227:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909232:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909238:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909243:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909249:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909255:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909260:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909266:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909273:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909280:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909299:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909311:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909320:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909326:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909339:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909351:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909357:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909363:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909548:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909559:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.909567:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790971837.916552:0:6697:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cd4afd36000:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1790971837.916862:0:6698:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cd4afd37200:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1790971837.916932:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916939:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916944:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916949:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916954:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916959:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916963:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916968:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.916973:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917003:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917009:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917013:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917018:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917022:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917027:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917032:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917039:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917047:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917053:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917058:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917064:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917069:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917076:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917084:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917091:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917101:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917106:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917111:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917133:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917137:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917143:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917150:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917156:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917165:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917172:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917176:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917181:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917186:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917191:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917196:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917202:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917207:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917212:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917219:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917226:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917233:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917239:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917249:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917254:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917258:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917264:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917268:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917273:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917278:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917283:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917294:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917301:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917307:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917312:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917317:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917322:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917327:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917332:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.917345:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.919537:0:6700:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cd495b49200:6700] 1 exiting: rc = 0 00000100:00100000:2.0:1790971837.919543:0:6699:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cd4affbea00:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1790971837.920167:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920175:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920181:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920188:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920193:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920200:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920205:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920211:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920217:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920235:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920242:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920248:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920254:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920259:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920265:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920272:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920277:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920284:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920290:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920296:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920302:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920308:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920330:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920337:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920343:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920349:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920355:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920361:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920366:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920372:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920378:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920384:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920389:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920410:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920429:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920436:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920442:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920447:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920453:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920459:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920464:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920495:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920504:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920510:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920515:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920524:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920549:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920557:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920563:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920569:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920575:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920580:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920586:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920592:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920598:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920690:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920697:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920703:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920790:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920798:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920803:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920809:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920890:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790971837.920898:0:13323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790971837.934386:0:13323:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790971852.406064:0:13934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790971860.723654:0:14401:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790971860.723661:0:14401:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790971860.723762:0:14401:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cd485573800 00000020:01000004:0.0:1790971860.723776:0:14401:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790971860.723783:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790971860.723801:0:14401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cd49fdd3380) 00000020:00000080:0.0:1790971860.723824:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790971860.759799:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790971860.766705:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1790971860.767032:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 461: rc = 0 00100000:10000000:3.0:1790971860.768894:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790971860.768987:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 461: rc = 0 00100000:10000000:3.0:1790971860.769436:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 461: rc = 0 00100000:10000000:3.0:1790971860.769738:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 461: rc = 0 00100000:10000000:3.0:1790971860.769818:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 461: rc = 0 00100000:10000000:3.0:1790971860.769940:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 461: rc = 0 00100000:10000000:3.0:1790971860.772991:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 463: rc = 0 00100000:10000000:3.0:1790971860.774694:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:3.0:1790971860.774800:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:3.0:1790971860.775324:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 352: rc = 0 00100000:10000000:3.0:1790971860.775616:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 352: rc = 0 00100000:10000000:3.0:1790971860.775865:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 352: rc = 0 00100000:10000000:3.0:1790971860.776085:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 352: rc = 0 00100000:10000000:3.0:1790971860.776326:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 352: rc = 0 00100000:10000000:3.0:1790971860.776831:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 352: rc = 0 00100000:10000000:3.0:1790971860.777317:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 352: rc = 0 00100000:10000000:3.0:1790971860.777685:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 352: rc = 0 00100000:10000000:3.0:1790971860.777926:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 352: rc = 0 00100000:10000000:3.0:1790971860.778237:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 352: rc = 0 00100000:10000000:3.0:1790971860.782243:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 352: rc = 0 00100000:10000000:3.0:1790971860.782754:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 352: rc = 0 00100000:10000000:3.0:1790971860.783466:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 525: rc = 0 00100000:10000000:3.0:1790971860.783741:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 525: rc = 0 00100000:10000000:3.0:1790971860.783955:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 525: rc = 0 00100000:10000000:3.0:1790971860.785732:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 525: rc = 0 00100000:10000000:3.0:1790971860.786010:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 525: rc = 0 00100000:10000000:3.0:1790971860.787618:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 525: rc = 0 00100000:10000000:3.0:1790971860.787882:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 525: rc = 0 00100000:10000000:3.0:1790971860.792578:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 525: rc = 0 00100000:10000000:3.0:1790971860.792879:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 525: rc = 0 00100000:10000000:3.0:1790971860.793134:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 525: rc = 0 00100000:10000000:3.0:1790971860.793799:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 525: rc = 0 00100000:10000000:3.0:1790971860.798625:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 525: rc = 0 00100000:10000000:3.0:1790971860.798919:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 525: rc = 0 00100000:10000000:3.0:1790971860.799204:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 525: rc = 0 00100000:10000000:3.0:1790971860.799497:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 525: rc = 0 00100000:10000000:3.0:1790971860.799762:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 525: rc = 0 00100000:10000000:3.0:1790971860.800003:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 525: rc = 0 00100000:10000000:3.0:1790971860.800265:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 525: rc = 0 00100000:10000000:3.0:1790971860.800549:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 525: rc = 0 00100000:10000000:3.0:1790971860.800805:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 525: rc = 0 00100000:10000000:3.0:1790971860.801043:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 525: rc = 0 00100000:10000000:2.0:1790971860.805682:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 525: rc = 0 00100000:10000000:2.0:1790971860.805948:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 525: rc = 0 00100000:10000000:2.0:1790971860.806212:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 525: rc = 0 00100000:10000000:2.0:1790971860.806459:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 525: rc = 0 00100000:10000000:2.0:1790971860.806728:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 525: rc = 0 00100000:10000000:2.0:1790971860.806969:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 525: rc = 0 00100000:10000000:2.0:1790971860.807206:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 525: rc = 0 00100000:10000000:2.0:1790971860.807452:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 525: rc = 0 00100000:10000000:2.0:1790971860.807737:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 525: rc = 0 00100000:10000000:2.0:1790971860.807976:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 525: rc = 0 00100000:10000000:2.0:1790971860.808242:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 525: rc = 0 00100000:10000000:2.0:1790971860.812017:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 649: rc = 0 00100000:10000000:2.0:1790971860.812732:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790971860.812890:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 518: rc = 0 00100000:10000000:2.0:1790971860.813084:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790971860.813150:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 518: rc = 0 00100000:10000000:2.0:1790971860.813862:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790971860.813939:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 518: rc = 0 00100000:10000000:2.0:1790971860.815006:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790971860.815087:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1790971860.815446:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790971860.815728:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:2.0:1790971860.818024:0:14401:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790971860.818213:0:14401:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00000020:00000080:2.0:1790971860.819294:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790971860.819302:0:14401:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790971860.819313:0:14401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4a535 00000020:01000004:2.0:1790971860.819321:0:14401:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790971860.819326:0:14401:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790971860.819347:0:14401:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cd485573800 from MGS 00000020:01000004:2.0:1790971860.819351:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790971860.819368:0:14401:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cd4be2a0000) 00000020:00000080:2.0:1790971860.819379:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790971860.819444:0:14401:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd485573800 from MGS, refs=2 00080000:01000000:2.0:1790971860.819449:0:14401:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790971860.819453:0:14401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4a543 00000100:00100000:2.0:1790971860.819785:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790971860.819908:0:14401:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790971860.819914:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790971860.820790:0:14401:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790971860.820798:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790971860.821706:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971860.821860:0:14401:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790971860.821864:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790971860.827408:0:14401:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790971860.829943:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790971860.830532:0:14401:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790971860.830540:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790971860.832945:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971860.832949:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971860.832951:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971860.833167:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971860.833169:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971860.833171:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971860.834154:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790971860.839750:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790971860.864112:0:14401:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790971860.864131:0:14401:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790971860.864134:0:14401:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790971860.867250:0:14410:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790971860.867427:0:14401:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790971860.868153:0:14401:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790971860.869226:0:14401:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790971860.870795:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971860.871081:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790971860.871087:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790971860.880935:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790971860.880952:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790971860.882755:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790971860.882768:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1790971860.885437:0:14415:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1790971860.885740:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790971860.885959:0:14401:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:2.0:1790971860.885961:0:14401:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790971860.885990:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:2.0:1790971860.886003:0:14401:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (ffff8cd4be2a19c0) 00000020:00000080:2.0:1790971860.886017:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790971860.886088:0:14401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd4835ca800@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1790971860.886405:0:14401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:2.0:1790971860.886414:0:14401:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 10000000:01000000:3.0:1790971860.889706:0:14416:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790971860.889805:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid 6e841c93-8375-413d-802b-5f81a8a5481c) 00000020:00000080:2.0:1790971860.889982:0:14401:0:(genops.c:1384:class_connect()) connect: client 6e841c93-8375-413d-802b-5f81a8a5481c, cookie 0xbd3388eaa6f4a551 00000100:00080000:2.0:1790971860.889995:0:14401:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790971860.890007:0:14401:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff8cd4835ca800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1790971860.890039:0:14401:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4bdda3b80 x1877969766271232/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790971860.890149:0:14401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6e841c93-8375-413d-802b-5f81a8a5481c->MGS 00000020:01000004:2.0:1790971860.890169:0:14401:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790971860.890174:0:14401:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790971860.890187:0:14401:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cd4be2a3380) 00000020:00000080:2.0:1790971860.890198:0:14401:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790971860.890849:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e841c93-8375-413d-802b-5f81a8a5481c:3301:1877969766271232:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790971860.890917:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971860.892535:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766271232 00000100:00100000:0.0:1790971860.892551:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766271232 00000100:00100000:0.0:1790971860.892586:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971860.892593:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1877969766271232:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790971860.892620:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6e841c93-8375-413d-802b-5f81a8a5481c@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1790971860.892648:0:14411:0:(genops.c:1384:class_connect()) connect: client 6e841c93-8375-413d-802b-5f81a8a5481c, cookie 0xbd3388eaa6f4a55f 00000100:00080000:0.0:1790971860.892791:0:14411:0:(import.c:65:import_set_state_nolock()) ffff8cd4be52e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971860.893213:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+5:3301:x1877969766271232:12345-0@lo:250:mount.lustre.0 Request processed in 617us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971860.893222:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790971860.893571:0:3301:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790971860.893580:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:2.0:1790971860.893587:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790971860.893592:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790971860.893596:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4835ca800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790971860.893598:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790971860.893609:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790971860.893613:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6e841c93-8375-413d-802b-5f81a8a5481c:3301:1877969766271232:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790971860.911439:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971860.912026:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790971860.912040:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790971860.913321:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790971860.913331:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790971860.921258:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790971860.921272:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790971860.922230:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971860.922459:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790971860.922465:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790971860.923761:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790971860.923770:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790971860.981064:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971860.983778:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790971860.983789:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790971860.985969:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790971860.985981:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790971860.989681:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971860.989851:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790971860.989857:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790971860.990796:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790971860.990806:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790971860.991891:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971860.992052:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790971860.992057:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790971860.999223:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790971860.999254:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790971861.000158:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971861.000395:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790971861.000400:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790971861.001026:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790971861.001032:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790971861.018465:0:14401:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971861.019057:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790971861.019064:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790971861.020261:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790971861.020272:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790971861.021151:0:14401:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790971861.021160:0:14401:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790971861.022073:0:14401:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790971861.022097:0:14401:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790971861.022104:0:14401:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790971861.022245:0:14401:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790971861.022280:0:14401:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790971861.022287:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790971861.022289:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971861.022290:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971861.022291:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971861.022292:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971861.022293:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971861.022295:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971861.022296:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971861.022298:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971861.022299:0:14401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790971861.022301:0:14401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790971861.022302:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790971861.022303:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971861.022304:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971861.022305:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971861.022306:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971861.022307:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971861.022307:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971861.022308:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971861.022309:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971861.022310:0:14401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790971861.022334:0:14401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790971861.022354:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790971861.022434:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971861.022520:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b66c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.022592:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766271360 00000100:00100000:3.0:1790971861.022601:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766271360 00000100:00100000:3.0:1790971861.022646:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971861.022657:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+5:14401:x1877969766271360:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790971861.022942:0:14414:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790971861.022945:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790971861.022948:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790971861.023268:0:14435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790971861.023659:0:14414:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1790971861.024750:0:14436:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790971861.024755:0:14436:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790971861.024758:0:14436:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790971861.024790:0:14436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790971861.025045:0:14414:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790971861.025055:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790971861.031498:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+5:14401:x1877969766271360:12345-0@lo:253:mount.lustre.0 Request processed in 8805us (9025us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971861.031526:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971861.031758:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271360:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790971861.031775:0:14401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790971861.031777:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790971861.031792:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790971861.031793:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971861.031795:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971861.031796:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971861.031797:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971861.031799:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790971861.031800:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790971861.031802:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971861.031803:0:14401:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790971861.031823:0:14401:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cd485573800 from lustre-MDT0000 10000000:01000000:3.0:1790971861.031846:0:14401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790971861.031849:0:14401:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790971861.031853:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cd4be2a19c0 10000000:01000000:3.0:1790971861.031856:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790971861.031865:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cd4be2a19c0 from 1 10000000:01000000:3.0:1790971861.031867:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790971861.031904:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.031915:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.031924:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.031945:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790971861.031984:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.032064:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971861.032101:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766271488 00000100:00100000:0.0:1790971861.032109:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766271488 00000100:00100000:0.0:1790971861.032179:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971861.032188:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+5:14401:x1877969766271488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790971861.032201:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971861.032215:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4be12fc00/0xbd3388eaa6f4a56d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a566 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971861.032237:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4be12fc00/0xbd3388eaa6f4a56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a566 expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971861.032259:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4be12fc00/0xbd3388eaa6f4a56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a566 expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971861.032269:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12fc00, rc 0) 00000100:00100000:0.0:1790971861.032307:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+6:14401:x1877969766271488:12345-0@lo:101:mount.lustre.0 Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971861.032313:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790971861.032367:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971861.032380:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.032388:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.032439:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971861.032500:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.032819:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971861.032889:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766271616 00000100:00100000:2.0:1790971861.032894:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766271616 00000100:00100000:2.0:1790971861.032916:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790971861.032922:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+6:14401:x1877969766271616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971861.033199:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+6:14401:x1877969766271616:12345-0@lo:501:mount.lustre.0 Request processed in 276us (733us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790971861.033206:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790971861.033303:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271616:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790971861.033327:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790971861.033344:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.033354:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971861.033362:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cd485573800 10000000:01000000:3.0:1790971861.033366:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790971861.033369:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cd485573800 10000000:01000000:3.0:1790971861.033372:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790971861.033374:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cd485573800 from 1 10000000:01000000:3.0:1790971861.033377:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790971861.033394:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f4a574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.033401:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f4a574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.033409:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f4a574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.033424:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790971861.033457:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971861.033622:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766271744 00000100:00100000:2.0:1790971861.033627:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766271744 00000100:00100000:2.0:1790971861.033654:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790971861.033660:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+6:14401:x1877969766271744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790971861.033668:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971861.033680:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5f600/0xbd3388eaa6f4a57b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a574 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.033694:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5f600/0xbd3388eaa6f4a57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a574 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.033702:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5f600/0xbd3388eaa6f4a57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a574 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.033709:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f600, rc 0) 00000100:00100000:2.0:1790971861.033948:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+7:14401:x1877969766271744:12345-0@lo:101:mount.lustre.0 Request processed in 287us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971861.033954:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790971861.034007:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.034019:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971861.034031:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f4a574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a57b expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.034038:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f4a574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a57b expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971861.034048:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790971861.034101:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f4a574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a57b expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.034109:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002da00/0xbd3388eaa6f4a574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a57b expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971861.034113:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790971861.034117:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790971861.034120:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cd485573800 10000000:01000000:3.0:1790971861.034122:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790971861.034125:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790971861.034127:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790971861.034140:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f4a582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.034147:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f4a582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.034154:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f4a582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.034174:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790971861.034198:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.034220:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1790971861.034264:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766271872 00000100:00100000:1.0:1790971861.034269:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766271872 00000100:00100000:1.0:1790971861.034298:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790971861.034304:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+7:14401:x1877969766271872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790971861.034310:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971861.034319:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4a589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a582 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.034333:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4a589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a582 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.034342:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494934200/0xbd3388eaa6f4a589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a582 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.034357:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934200, rc 0) 00000100:00100000:1.0:1790971861.034394:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+8:14401:x1877969766271872:12345-0@lo:101:mount.lustre.0 Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.034400:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790971861.034463:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766271872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971861.034525:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f4a582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a589 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.034532:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f4a582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a589 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.034730:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766272000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971861.034756:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.034787:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1790971861.034833:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766272000 00000100:00100000:1.0:1790971861.034838:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766272000 00000100:00100000:1.0:1790971861.034866:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790971861.034872:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+8:14401:x1877969766272000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971861.035216:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+9:14401:x1877969766272000:12345-0@lo:501:mount.lustre.0 Request processed in 343us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.035223:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790971861.035255:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766272000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971861.035282:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766272128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790971861.035318:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.035338:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766272128 00000100:00100000:1.0:1790971861.035341:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766272128 00000100:00100000:1.0:1790971861.035357:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790971861.035362:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+9:14401:x1877969766272128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790971861.035801:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+9:14401:x1877969766272128:12345-0@lo:503:mount.lustre.0 Request processed in 437us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.035808:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790971861.035839:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be383a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790971861.035852:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766272128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971861.036309:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14437:1877969766272256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971861.036347:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.036378:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c5000 going to sleep for 11 seconds 00000100:00100000:1.0:1790971861.036425:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766272256 00000100:00100000:1.0:1790971861.036436:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766272256 00000100:00100000:1.0:1790971861.036491:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790971861.036498:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+9:14437:x1877969766272256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971861.036903:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+9:14437:x1877969766272256:12345-0@lo:502:llog_process_th.0 Request processed in 405us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.036910:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790971861.036989:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14437:1877969766272256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790971861.037013:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971861.037023:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971861.037025:0:14437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790971861.037031:0:14437:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790971861.037034:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790971861.037049:0:14437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cd48824cd40) 00000020:00000080:3.0:1790971861.037063:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790971861.037068:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790971861.037144:0:14437:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790971861.037151:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4a597 00000020:00000080:3.0:1790971861.037347:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790971861.037352:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971861.037355:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971861.037357:0:14437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790971861.037360:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790971861.037363:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971861.037365:0:14437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790971861.037368:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790971861.037376:0:14437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cd488248000) 00000020:00000080:3.0:1790971861.037384:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790971861.037387:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790971861.037389:0:14437:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790971861.037392:0:14437:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790971861.037397:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790971861.037433:0:14437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd485573800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790971861.037446:0:14437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cd48824b380) 00000020:00000080:3.0:1790971861.037453:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790971861.037675:0:14437:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790971861.037682:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f4a5ac 00000020:00000080:3.0:1790971861.037773:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790971861.037779:0:14437:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790971861.037783:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbd3388eaa6f4a5b3 00080000:01000000:3.0:1790971861.037789:0:14437:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790971861.037792:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4a5ba 00010000:00010000:3.0:1790971861.090352:0:14437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790971861.090973:0:14437:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1790971861.091147:0:14437:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790971861.092828:0:14437:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cd4882499c0) 00000020:00000080:3.0:1790971861.092848:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790971861.092918:0:14437:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790971861.092925:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4a5c8 00000020:00000080:3.0:1790971861.096014:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790971861.103297:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbd3388eaa6f4a5cf 00000020:00000080:2.0:1790971861.103719:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790971861.103730:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971861.103737:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.103739:0:14437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790971861.103743:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971861.103749:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.103750:0:14437:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790971861.103755:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790971861.103800:0:14437:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790971861.103815:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971861.103819:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.103820:0:14437:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790971861.103823:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790971861.103825:0:14437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1790971861.103826:0:14437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790971861.103828:0:14437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790971861.103829:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790971861.103831:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.103833:0:14437:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790971861.103835:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790971861.103838:0:14437:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790971861.103841:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.103843:0:14437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790971861.103846:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790971861.103852:0:14437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:2.0:1790971861.103880:0:14437:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790971861.103882:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790971861.103897:0:14437:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cd4be2a4d40) 00000020:00000080:2.0:1790971861.103910:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790971861.103915:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790971861.103966:0:14437:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790971861.103973:0:14437:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790971861.103979:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4a5dd 00010000:00080000:2.0:1790971861.104009:0:14437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd4835cc800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1790971861.104213:0:14437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1790971861.104933:0:14437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790971861.104980:0:14437:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790971861.106740:0:14437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790971861.106812:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790971861.106883:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1790971861.107807:0:14441:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790971861.107813:0:14441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790971861.108433:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790971861.108447:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790971861.108522:0:14437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790971861.108541:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f4a5e4 00000100:00080000:3.0:1790971861.108662:0:14437:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790971861.108674:0:14437:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cd4835cc800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1790971861.108710:0:14437:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd495acf800 x1877969766272384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790971861.108738:0:14437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790971861.108794:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790971861.108798:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971861.108801:0:14437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790971861.108804:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790971861.108806:0:14437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1790971861.108808:0:14437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790971861.108809:0:14437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790971861.108810:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790971861.108812:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971861.108813:0:14437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790971861.108815:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790971861.108819:0:14437:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790971861.108822:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971861.108823:0:14437:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790971861.108826:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790971861.108829:0:14437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:3.0:1790971861.108850:0:14437:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790971861.108853:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790971861.108870:0:14437:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cd495694d40) 00000020:00000080:3.0:1790971861.108880:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790971861.108884:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790971861.108947:0:14437:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790971861.108952:0:14437:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790971861.108957:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd3388eaa6f4a5f2 00010000:00080000:3.0:1790971861.108989:0:14437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd49633d000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1790971861.109183:0:14437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1790971861.109353:0:14437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790971861.109373:0:14437:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1790971861.109671:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766272384:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790971861.109722:0:3301:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877969766272384 offset 0 length 520: 4 00000100:00100000:0.0:1790971861.109957:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790971861.109966:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766272512:0@lo:400:kworker.0 00000100:00100000:0.0:1790971861.110006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971861.110039:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766272512 00000100:00100000:0.0:1790971861.110045:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766272512 00000100:00100000:0.0:1790971861.110081:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971861.110089:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+9:3305:x1877969766272512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971861.110136:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+9:3305:x1877969766272512:12345-0@lo:400:kworker.0 Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971861.110144:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971861.110191:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766272512:0@lo:400:kworker.0 00000040:00080000:3.0:1790971861.112342:0:14437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790971861.112434:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790971861.114206:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1790971861.116362:0:14443:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790971861.116368:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790971861.117151:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790971861.117164:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790971861.117197:0:14437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790971861.117215:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f4a5f9 00000100:00080000:2.0:1790971861.117227:0:14437:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790971861.117240:0:14437:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cd49633d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1790971861.117274:0:14437:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4bdda3100 x1877969766272640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790971861.117336:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766272640:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790971861.117386:0:3301:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877969766272640 offset 0 length 520: 4 00000100:00080000:2.0:1790971861.117439:0:14437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790971861.117533:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971861.117538:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.117539:0:14437:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790971861.117542:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971861.117555:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.117556:0:14437:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790971861.117560:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790971861.117562:0:14437:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790971861.117565:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971861.117567:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.117568:0:14437:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790971861.117571:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971861.117573:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.117574:0:14437:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790971861.117578:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790971861.117607:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14437:1877969766272768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971861.117662:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971861.117678:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b251b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971861.117770:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766272768 00000100:00100000:1.0:1790971861.117778:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766272768 00000100:00100000:1.0:1790971861.117813:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790971861.117820:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+9:14437:x1877969766272768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971861.118037:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+9:14437:x1877969766272768:12345-0@lo:502:llog_process_th.0 Request processed in 215us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.118044:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971861.118201:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14437:1877969766272768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790971861.118231:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971861.118235:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971861.118237:0:14437:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790971861.118241:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1790971861.119030:0:14401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1790971861.119049:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790971861.119071:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f4a582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a589 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.119082:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002cc00/0xbd3388eaa6f4a582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a589 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971861.119091:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd485573800 from 1 10000000:01000000:1.0:1790971861.119094:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790971861.119122:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.119130:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.119147:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971861.119165:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766272896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790971861.119202:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.119234:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971861.119280:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766272896 00000100:00100000:2.0:1790971861.119286:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766272896 00000100:00100000:2.0:1790971861.119322:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971861.119330:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+9:14401:x1877969766272896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790971861.119340:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971861.119355:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a600 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.119375:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.119386:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.119395:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f800, rc 0) 00000100:00100000:2.0:1790971861.119429:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+10:14401:x1877969766272896:12345-0@lo:101:mount.lustre.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971861.119435:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790971861.119709:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766272896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790971861.119722:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.119730:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971861.120295:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273024:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790971861.120336:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.120370:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971861.120428:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273024 00000100:00100000:0.0:1790971861.120434:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273024 00000100:00100000:0.0:1790971861.120708:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790971861.120719:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+10:14401:x1877969766273024:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790971861.120738:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790971861.120744:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790971861.120820:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+10:14401:x1877969766273024:12345-0@lo:256:mount.lustre.0 Request processed in 103us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971861.120834:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790971861.120976:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273024:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790971861.121621:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790971861.121641:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.121651:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971861.121659:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd485573800 from 1 10000000:01000000:1.0:1790971861.121661:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790971861.121698:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.121706:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.121715:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971861.121732:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790971861.121771:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.122090:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971861.122136:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273152 00000100:00100000:2.0:1790971861.122143:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273152 00000100:00100000:3.0:1790971861.122462:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790971861.122519:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+10:14401:x1877969766273152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971861.122534:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971861.122885:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a60e expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.122912:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.122923:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.122932:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d200, rc 0) 00000100:00100000:3.0:1790971861.122995:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+11:14401:x1877969766273152:12345-0@lo:101:mount.lustre.0 Request processed in 494us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971861.123001:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790971861.123080:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790971861.123094:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.123102:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971861.123156:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971861.123183:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.123211:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790971861.123259:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273280 00000100:00100000:0.0:1790971861.123264:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273280 00000100:00100000:0.0:1790971861.123298:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790971861.123305:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+11:14401:x1877969766273280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790971861.123736:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+11:14401:x1877969766273280:12345-0@lo:501:mount.lustre.0 Request processed in 431us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971861.123743:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790971861.124223:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971861.124263:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790971861.124306:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.124337:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.124498:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273408 00000100:00100000:3.0:1790971861.124504:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273408 00000100:00100000:3.0:1790971861.124540:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790971861.124614:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+11:14401:x1877969766273408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971861.124782:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+11:14401:x1877969766273408:12345-0@lo:503:mount.lustre.0 Request processed in 235us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971861.124789:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790971861.124912:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790971861.125259:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14445:1877969766273536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971861.125295:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.125325:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.125368:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273536 00000100:00100000:3.0:1790971861.125372:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273536 00000100:00100000:3.0:1790971861.125434:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790971861.125442:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+11:14445:x1877969766273536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971861.125672:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+11:14445:x1877969766273536:12345-0@lo:502:llog_process_th.0 Request processed in 230us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971861.125680:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790971861.125875:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14445:1877969766273536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790971861.125898:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971861.125908:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971861.125910:0:14445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790971861.125917:0:14445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd485573800 00000020:00000080:1.0:1790971861.125919:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971861.125927:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971861.125930:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971861.125931:0:14445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790971861.125933:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971861.125936:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971861.125937:0:14445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790971861.125941:0:14445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd485573800 00000020:00000080:1.0:1790971861.125943:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971861.126004:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971861.126008:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971861.126009:0:14445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790971861.126011:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971861.126013:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971861.126014:0:14445:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790971861.126018:0:14445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cd485573800 00000020:00000080:1.0:1790971861.126020:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790971861.126055:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14445:1877969766273664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971861.126087:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.126105:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971861.126152:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273664 00000100:00100000:2.0:1790971861.126158:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273664 00000100:00100000:2.0:1790971861.126179:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790971861.126186:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+11:14445:x1877969766273664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971861.126322:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+11:14445:x1877969766273664:12345-0@lo:502:llog_process_th.0 Request processed in 135us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971861.126335:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790971861.129664:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14445:1877969766273664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790971861.129714:0:14445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971861.129721:0:14445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971861.129723:0:14445:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790971861.129728:0:14445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790971861.129904:0:14401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790971861.129927:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790971861.129953:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.129964:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971861.130010:0:14401:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790971861.130013:0:14401:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cd485573800 10000000:01000000:3.0:1790971861.130016:0:14401:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cd485573800 10000000:01000000:3.0:1790971861.130027:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790971861.130033:0:14401:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd485573800 from 1 10000000:01000000:3.0:1790971861.130036:0:14401:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790971861.130068:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c800/0xbd3388eaa6f4a61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.130078:0:14401:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c800/0xbd3388eaa6f4a61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.130087:0:14401:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c800/0xbd3388eaa6f4a61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.130109:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790971861.130168:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.130210:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a66c50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971861.137081:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273792 00000100:00100000:2.0:1790971861.137096:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273792 00000100:00100000:2.0:1790971861.137166:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790971861.137176:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+11:14401:x1877969766273792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790971861.137193:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971861.137211:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5e200/0xbd3388eaa6f4a623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a61c expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.137238:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5e200/0xbd3388eaa6f4a623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a61c expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.137249:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5e200/0xbd3388eaa6f4a623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a61c expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.137257:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e200, rc 0) 00000100:00100000:2.0:1790971861.137329:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14401:x1877969766273792:12345-0@lo:101:mount.lustre.0 Request processed in 155us (7162us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971861.137337:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790971861.138667:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971861.138692:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c800/0xbd3388eaa6f4a61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a623 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.138703:0:14401:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c800/0xbd3388eaa6f4a61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a623 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.138779:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971861.138831:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.138866:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd489cab840 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.138891:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766273920 00000100:00100000:3.0:1790971861.138897:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766273920 00000100:00100000:3.0:1790971861.138929:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790971861.138936:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:14401:x1877969766273920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971861.139214:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:14401:x1877969766273920:12345-0@lo:501:mount.lustre.0 Request processed in 277us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971861.139222:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790971861.139259:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766273920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971861.139286:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766274048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971861.139321:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.139335:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd489cab840 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.139349:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274048 00000100:00100000:3.0:1790971861.139353:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274048 00000100:00100000:3.0:1790971861.139377:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790971861.139382:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:14401:x1877969766274048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971861.140709:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:14401:x1877969766274048:12345-0@lo:503:mount.lustre.0 Request processed in 1321us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971861.140720:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790971861.140819:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766274048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790971861.143815:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14450:1877969766274176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790971861.143892:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971861.143962:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4959e69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.144000:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274176 00000100:00100000:3.0:1790971861.144008:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274176 00000100:00100000:3.0:1790971861.144080:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790971861.144090:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14450:x1877969766274176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790971861.144369:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14450:x1877969766274176:12345-0@lo:502:llog_process_th.0 Request processed in 279us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971861.144378:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790971861.144530:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14450:1877969766274176:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790971861.144653:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790971861.144668:0:14450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cd4be0419c0) 00000020:00000080:1.0:1790971861.144686:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1790971861.144758:0:14450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd485573800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790971861.144762:0:14450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd485573800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790971861.144765:0:14450:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd485573800 4 00010000:00080000:1.0:1790971861.144798:0:14450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd4bd8ca800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1790971861.148291:0:14450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1790971861.148650:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790971861.148693:0:14450:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790971861.148706:0:14450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbd3388eaa6f4a631 00000100:00080000:1.0:1790971861.148717:0:14450:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790971861.148730:0:14450:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cd4bd8ca800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971861.148767:0:14450:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4a66b6d80 x1877969766274304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790971861.148797:0:14450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790971861.148939:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766274304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790971861.149002:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.149098:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274304 00000100:00100000:1.0:1790971861.149105:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274304 00000100:00100000:1.0:1790971861.149139:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790971861.149146:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1877969766274304:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790971861.149197:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1877969766274304:12345-0@lo:38:llog_process_th.0 Request processed in 49us (194us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790971861.149214:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790971861.149249:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790971861.149255:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4bd8ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790971861.149259:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790971861.149262:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766274304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790971861.150065:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14450:1877969766274432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971861.150116:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.150143:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274432 00000100:00100000:1.0:1790971861.150147:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274432 00000100:00100000:1.0:1790971861.150179:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790971861.150186:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:14450:x1877969766274432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790971861.150457:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:14450:x1877969766274432:12345-0@lo:502:llog_process_th.0 Request processed in 270us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.150465:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790971861.150910:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4956b2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790971861.150928:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6e841c93-8375-413d-802b-5f81a8a5481c:14450:1877969766274432:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790971861.150952:0:14450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790971861.153999:0:14401:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790971861.154032:0:14401:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790971861.154051:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c800/0xbd3388eaa6f4a61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a623 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.154068:0:14401:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c800/0xbd3388eaa6f4a61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a623 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790971861.154115:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790971861.154117:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971861.154118:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971861.154119:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971861.154121:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971861.154122:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971861.154123:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971861.154125:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971861.154127:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971861.154128:0:14401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790971861.154131:0:14401:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790971861.154134:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790971861.154135:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971861.154136:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971861.154137:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971861.154139:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971861.154139:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971861.154140:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971861.154141:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971861.154142:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971861.154143:0:14401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790971861.154170:0:14401:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790971861.154189:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766274560:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790971861.154268:0:14401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971861.154304:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4959e6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971861.154457:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274560 00000100:00100000:3.0:1790971861.154464:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274560 00000100:00100000:3.0:1790971861.155016:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790971861.155023:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14401:x1877969766274560:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790971861.155049:0:14411:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790971861.155063:0:14411:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790971861.200054:0:14411:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790971861.200065:0:14411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790971861.200448:0:14435:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790971861.200454:0:14435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790971861.200624:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.200647:0:14435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.200657:0:14435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.200701:0:14435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971861.200715:0:14435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 12 pid: 14411 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971861.200730:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14435:1877969766274688:0@lo:104: 00000100:00100000:3.0:1790971861.200797:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971861.201082:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be38a480 going to sleep for 11 seconds 00000100:00100000:0.0:1790971861.201281:0:14402:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274688 00000100:00100000:0.0:1790971861.201290:0:14402:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274688 00000100:00100000:0.0:1790971861.201339:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971861.201349:0:14402:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+3:14435:x1877969766274688:12345-0@lo:104: 00010000:00010000:0.0:1790971861.201362:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971861.201422:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790971861.201427:0:14402:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+3:14435:x1877969766274688:12345-0@lo:104: Request processed in 81us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971861.201434:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790971861.201576:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971861.201584:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.201592:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934a00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:1.0:1790971861.201597:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.201616:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971861.201624:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971861.201632:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790971861.201668:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.201674:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971861.201702:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.201709:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494934a00/0xbd3388eaa6f4a600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a607 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.201725:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971861.201727:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971861.201729:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971861.201785:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14435:1877969766274688:0@lo:104: 00010000:00010000:3.0:1790971861.201805:0:14435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971861.201833:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766274816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790971861.201871:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971861.201976:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274816 00000100:00100000:1.0:1790971861.201980:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274816 00010000:00010000:1.0:1790971861.202000:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 13 pid: 14411 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971861.202033:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790971861.202040:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+13:3305:x1877969766274816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971861.202051:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971861.202056:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 13 pid: 14411 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202072:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 13 pid: 14411 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202085:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4a600 expref: 13 pid: 14411 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202098:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202106:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790971861.202120:0:14404:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001665868s 00010000:00010000:1.0:1790971861.202124:0:14404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202131:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202137:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202142:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202148:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971861.202152:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202160:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202181:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.202190:0:14435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971861.202191:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971861.202213:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971861.202220:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002d800/0xbd3388eaa6f4a638 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971861.202239:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+12:3305:x1877969766274816:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.202247:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971861.202645:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766274816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971861.219664:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+11:14401:x1877969766274560:12345-0@lo:253:mount.lustre.0 Request processed in 64632us (65388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971861.219679:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790971861.219795:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:14401:1877969766274560:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790971861.219812:0:14401:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790971861.219815:0:14401:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790971861.219817:0:14401:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790971861.219818:0:14401:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971861.219819:0:14401:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971861.219820:0:14401:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971861.219822:0:14401:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971861.219823:0:14401:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790971861.219950:0:14401:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790971861.219953:0:14401:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971861.219954:0:14401:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790971861.219973:0:14401:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790971861.227023:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971861.227193:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790971861.228799:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971861.230780:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790971861.231501:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971861.231645:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790971861.235699:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790971861.235993:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790971861.236262:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790971861.236446:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790971861.238078:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790971861.238245:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1790971861.304983:0:14401:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1790971861.305283:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790971861.305410:0:14457:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1790971861.305422:0:14457:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1790971861.305798:0:14458:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1790971861.305861:0:14458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790971861.308972:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790971861.309036:0:14458:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790971861.309041:0:14458:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1790971861.311656:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790971861.311874:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790971861.312301:0:14401:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790971861.312309:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790971861.312435:0:14401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790971861.315925:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790971861.317145:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790971861.318451:0:14401:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1790971861.323450:0:14401:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1790971861.333111:0:14401:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790971861.397555:0:14401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790971861.397607:0:14401:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa77fc1c9b988 00100000:10000000:3.0:1790971861.397620:0:14401:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790971861.400459:0:14401:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790971861.400521:0:14401:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790971861.400535:0:14401:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790971861.400556:0:14401:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1790971861.875227:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790971862.182747:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790971862.886578:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790971862.886610:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790971862.886615:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd485573800 from 6 10000000:01000000:3.0:1790971862.886619:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790971862.886670:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971862.886681:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971862.886692:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971862.886715:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766274944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790971862.886795:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971862.886836:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766274944 00000100:00100000:2.0:1790971862.886845:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766274944 00000100:00100000:3.0:1790971862.886854:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be38a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971862.886893:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790971862.886905:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+11:14416:x1877969766274944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971862.886918:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971862.886931:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a63f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971862.886954:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971862.886965:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971862.886974:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fa00, rc 0) 00000100:00100000:2.0:1790971862.887024:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766274944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971862.887031:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790971862.887252:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766274944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971862.887267:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971862.887275:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971862.887347:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790971862.887445:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971862.887673:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be38a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971862.890406:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275072 00000100:00100000:2.0:1790971862.890418:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275072 00000100:00100000:2.0:1790971862.890484:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790971862.890492:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766275072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790971862.890525:0:14411:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790971862.890543:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790971862.890546:0:14411:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790971862.890661:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766275072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971862.890672:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790971862.891102:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790971862.891210:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790971862.891219:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971862.891231:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790971863.211252:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790971863.908606:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971864.935601:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790971865.769951:0:14701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790971865.960690:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790971866.471577:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790971866.471584:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790971866.471588:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790971866.471590:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790971866.471593:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790971866.471596:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790971866.471600:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cd4bd8ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790971866.471615:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cd4bd8ca800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971866.471644:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4a66b5500 x1877969766275328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790971866.471686:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766275328:0@lo:38:kworker.0 00000100:00100000:1.0:1790971866.471748:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971866.471932:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766275200:0@lo:400:kworker.0 00000100:00100000:0.0:1790971866.471966:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971866.472014:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275328 00000100:00100000:0.0:1790971866.472022:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275328 00000100:00100000:0.0:1790971866.472050:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790971866.472057:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1877969766275328:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790971866.472082:0:14421:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:0.0:1790971866.472115:0:14421:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbd3388eaa6f4a64d 00000004:00100000:0.0:1790971866.472129:0:14421:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790971866.472253:0:14421:0:(import.c:65:import_set_state_nolock()) ffff8cd4b522b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971866.472305:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877969766275328:12345-0@lo:38:kworker.0 Request processed in 246us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971866.472312:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790971866.472334:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275200 00000100:00100000:0.0:1790971866.472338:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275200 00000100:00100000:0.0:1790971866.472365:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790971866.472371:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:3302:x1877969766275200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971866.472418:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:3302:x1877969766275200:12345-0@lo:400:kworker.0 Request processed in 47us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971866.472425:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1790971866.473145:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cd4a66b5500 x1877969766275328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790971876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790971866.473161:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790971866.473168:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790971866.473173:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790971866.473181:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4bd8ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790971866.473187:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877969766275328:0@lo:38:kworker.0 00000100:00100000:0.0:1790971866.473218:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766275200:0@lo:400:kworker.0 00010000:00010000:1.0:1790971866.986685:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971868.004822:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790971868.770702:0:14852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3d4ed730 20000000:00000080:0.0:1790971868.770718:0:14852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cd4b735e000 uarg=0000000000000000 20000000:01000000:0.0:1790971868.770751:0:14852:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790971868.770758:0:14852:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790971868.770764:0:14852:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790971868.774679:0:14853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1790971868.775991:0:14852:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790971868.789612:0:14852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790971868.789644:0:14852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971868.789662:0:14852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971868.789671:0:14852:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971868.789712:0:14852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971868.789729:0:14852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 11 pid: 14413 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971868.789742:0:14852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14852:1877969766275456:0@lo:104: 00000100:00100000:0.0:1790971868.789882:0:14852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971868.790034:0:14852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971868.790194:0:14403:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275456 00000100:00100000:1.0:1790971868.790203:0:14403:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275456 00000100:00100000:1.0:1790971868.792793:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971868.792812:0:14403:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e841c93-8375-413d-802b-5f81a8a5481c+3:14852:x1877969766275456:12345-0@lo:104: 00010000:00010000:1.0:1790971868.792829:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971868.792939:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790971868.792945:0:14403:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e841c93-8375-413d-802b-5f81a8a5481c+3:14852:x1877969766275456:12345-0@lo:104: Request processed in 143us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971868.792951:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790971868.792984:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971868.792990:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971868.792998:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934c00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:1.0:1790971868.793002:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971868.793011:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790971868.793017:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971868.793036:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790971868.793082:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971868.793088:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790971868.793109:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971868.793115:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd494934c00/0xbd3388eaa6f4a60e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a615 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971868.793133:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971868.793135:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971868.793137:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971868.793145:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790971868.793159:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766275584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971868.793199:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971868.793714:0:14852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14852:1877969766275456:0@lo:104: 00010000:00010000:3.0:1790971868.793738:0:14852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971868.794952:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275584 00000100:00100000:2.0:1790971868.794971:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275584 00010000:00010000:2.0:1790971868.795020:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 12 pid: 14413 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971868.795065:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971868.795076:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e841c93-8375-413d-802b-5f81a8a5481c+12:3302:x1877969766275584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790971868.795123:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971868.795131:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 12 pid: 14413 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795145:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 12 pid: 14413 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795168:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002d200/0xbd3388eaa6f4a615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4a60e expref: 12 pid: 14413 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795188:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795199:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795219:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795235:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795242:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795250:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795258:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971868.795263:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795271:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795290:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971868.795301:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971868.795408:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e841c93-8375-413d-802b-5f81a8a5481c+11:3302:x1877969766275584:12345-0@lo:103:ldlm_bl.0 Request processed in 330us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971868.795418:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971868.795462:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766275584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790971868.795793:0:14852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971868.795807:0:14852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971868.795815:0:14852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4be12f200/0xbd3388eaa6f4a654 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971869.046705:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971870.054777:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790971870.820552:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790971870.820639:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd485573800 from 10 10000000:01000000:3.0:1790971870.820645:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790971870.820687:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971870.820699:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971870.820711:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971870.820735:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790971870.820807:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971870.823698:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275712 00000100:00100000:2.0:1790971870.823712:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275712 00000100:00100000:2.0:1790971870.823773:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790971870.823782:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+11:14416:x1877969766275712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971870.823798:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971870.823819:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a65b expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971870.823856:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971870.823867:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971870.823875:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e800, rc 0) 00000100:00100000:2.0:1790971870.823928:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766275712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971870.823935:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790971870.824034:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be38a540 going to sleep for 11 seconds 00000100:00100000:3.0:1790971870.824058:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971870.824075:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971870.824085:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971870.824152:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971870.824184:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971870.824208:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4be38a540 going to sleep for 11 seconds 00000100:00100000:2.0:1790971870.825811:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275840 00000100:00100000:2.0:1790971870.825826:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275840 00000100:00100000:2.0:1790971870.825984:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790971870.825995:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766275840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971870.826299:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766275840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971870.826307:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790971870.826650:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971870.826710:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971870.827124:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971870.827156:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b33cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971870.827861:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766275968 00000100:00100000:3.0:1790971870.827871:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766275968 00000100:00100000:3.0:1790971870.827922:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790971870.827930:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766275968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971870.828115:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:14416:x1877969766275968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971870.828128:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790971870.828289:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766275968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790971870.835281:0:14926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790971870.835651:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790971870.835673:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971870.835683:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971870.835695:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971871.078113:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971871.591882:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790971861/real 1790971861] req@ffff8cd4bdda3100 x1877969766272640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971871 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971871.591913:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cd4bdda3100 x1877969766272640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971871 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971871.591925:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790971861/real 1790971861] req@ffff8cd495acf800 x1877969766272384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971871 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971871.591938:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cd495acf800 x1877969766272384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971871 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790971871.591957:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790971871.591968:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790971871.591972:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766272640:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790971871.591978:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4835cc800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790971871.591994:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790971871.591998:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766272384:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790971871.592343:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790971871.592352:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790971871.592356:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cd4835cc800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790971871.592365:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1790971871.592371:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790971871.592455:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cd4835cc800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971871.592519:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4a66b6d80 x1877969766276224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790971871.592553:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790971871.592556:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790971871.592558:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790971871.592562:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1790971871.592565:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790971871.592571:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cd49633d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1790971871.592585:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4a66b5c00 x1877969766276352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790971871.592734:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766276480:0@lo:400:kworker.0 00000100:00100000:0.0:1790971871.592803:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971871.592858:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790971871.592866:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766276096:0@lo:400:kworker.0 00000100:00100000:0.0:1790971871.592897:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971871.592929:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766276224:0@lo:8:kworker.0 00000400:00000100:0.0:1790971871.592952:0:3301:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877969766276224 offset 0 length 520: 4 00000100:00100000:0.0:1790971871.592963:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766276352:0@lo:8:kworker.0 00000400:00000100:0.0:1790971871.592978:0:3301:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877969766276352 offset 0 length 520: 4 00000100:00100000:0.0:1790971871.593012:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766276480 00000100:00100000:0.0:1790971871.593018:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766276480 00000100:00100000:0.0:1790971871.593058:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971871.593067:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766276480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971871.593126:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766276480:12345-0@lo:400:kworker.0 Request processed in 59us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971871.593135:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790971871.593159:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766276096 00000100:00100000:0.0:1790971871.593163:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766276096 00000100:00100000:0.0:1790971871.593186:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790971871.593193:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:3305:x1877969766276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971871.593222:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+12:3305:x1877969766276096:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971871.593228:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790971871.593279:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766276096:0@lo:400:kworker.0 00010000:00080000:0.0:1790971871.593291:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cd4a66b4a80 x1877969766276480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971871.593301:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766276480:0@lo:400:kworker.0 00010000:00010000:1.0:1790971872.100881:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971873.128312:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790971873.446156:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790971874.149930:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790971874.389827:0:15102:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790971874.389831:0:15102:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790971874.389933:0:15102:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cd4be09e000 00000020:01000004:2.0:1790971874.389949:0:15102:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790971874.389960:0:15102:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790971874.389974:0:15102:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cd48794b380) 00000020:00000080:2.0:1790971874.389989:0:15102:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790971874.428492:0:15102:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790971874.428769:0:15102:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790971874.430800:0:15102:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790971874.431171:0:15102:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790971874.431434:0:15102:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790971874.431849:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 365: rc = 0 00100000:10000000:3.0:1790971874.432012:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 365: rc = 0 00100000:10000000:3.0:1790971874.432109:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 365: rc = 0 00100000:10000000:3.0:1790971874.432577:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 406: rc = 0 00100000:10000000:3.0:1790971874.432914:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 406: rc = 0 00100000:10000000:3.0:1790971874.433170:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 406: rc = 0 00100000:10000000:3.0:1790971874.433430:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 406: rc = 0 00100000:10000000:3.0:1790971874.433760:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 406: rc = 0 00100000:10000000:3.0:1790971874.434012:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 406: rc = 0 00000020:00000080:3.0:1790971874.440819:0:15102:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790971874.440831:0:15102:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790971874.440845:0:15102:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd3388eaa6f4a670 00000020:01000004:3.0:1790971874.442152:0:15102:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790971874.442179:0:15102:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790971874.442183:0:15102:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790971874.442191:0:15102:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790971874.442196:0:15102:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790971874.442326:0:15102:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cd4956919c0) 00000020:00000080:3.0:1790971874.442340:0:15102:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790971874.447406:0:15102:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790971874.447658:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790971874.447670:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790971874.447950:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790971874.447956:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790971874.452154:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790971874.452168:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790971874.461122:0:15102:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971874.461409:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790971874.461425:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790971874.462156:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790971874.462164:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790971874.536449:0:15102:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971874.536824:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790971874.536839:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790971874.545367:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790971874.545391:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790971874.552329:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790971874.552345:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790971874.565884:0:15102:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790971874.566115:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790971874.566121:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790971874.568685:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790971874.568698:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790971874.627296:0:15102:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790971874.627724:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790971874.627732:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790971874.628636:0:15102:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790971874.628645:0:15102:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790971874.629445:0:15102:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790971874.629500:0:15102:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790971874.629508:0:15102:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790971874.641742:0:15102:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790971874.641791:0:15102:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790971874.641796:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790971874.641798:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971874.641799:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971874.641801:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971874.641802:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971874.641804:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971874.641805:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971874.641807:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971874.641808:0:15102:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790971874.641812:0:15102:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790971874.641815:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790971874.641817:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971874.641818:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971874.641819:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971874.641820:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971874.641821:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971874.641822:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971874.641823:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971874.641824:0:15102:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790971874.641863:0:15102:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790971874.641884:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790971874.642070:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.642158:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b33c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971874.647128:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766276608 00000100:00100000:0.0:1790971874.647143:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766276608 00000100:00100000:0.0:1790971874.647210:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790971874.647220:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:15102:x1877969766276608:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790971874.647257:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790971874.647260:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790971874.647264:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790971874.653944:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:15102:x1877969766276608:12345-0@lo:253:mount.lustre.0 Request processed in 6707us (11856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971874.653963:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790971874.654563:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790971874.654601:0:15102:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790971874.654604:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790971874.654606:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971874.654607:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971874.654609:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971874.654610:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971874.654611:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971874.654613:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971874.654615:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971874.654616:0:15102:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790971874.654644:0:15102:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cd4be09e000 from lustre-OST0000 10000000:01000000:2.0:1790971874.654681:0:15102:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790971874.654684:0:15102:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790971874.654692:0:15102:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cd4be2a19c0 local copy 00010000:00010000:2.0:1790971874.654706:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971874.655021:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971874.655908:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971874.656290:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766276736 00000100:00100000:0.0:1790971874.656301:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766276736 00000100:00100000:2.0:1790971874.656574:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971874.656640:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790971874.656672:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:15102:x1877969766276736:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971874.659130:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+12:15102:x1877969766276736:12345-0@lo:501:mount.lustre.0 Request processed in 2231us (2995us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790971874.659150:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790971874.659291:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276736:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790971874.659320:0:15102:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790971874.660161:0:15102:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790971874.660177:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.660191:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971874.660468:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cd4be09e000 10000000:01000000:2.0:1790971874.660796:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790971874.660804:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cd4be2a19c0 10000000:01000000:2.0:1790971874.660806:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1790971874.660811:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cd4be2a19c0 from 1 10000000:01000000:2.0:1790971874.660814:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790971874.660863:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a67e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.660873:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a67e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.660886:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a67e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971874.660912:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790971874.661195:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.661383:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971874.667594:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766276864 00000100:00100000:0.0:1790971874.667617:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766276864 00000100:00100000:0.0:1790971874.668278:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790971874.668296:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+12:15102:x1877969766276864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790971874.668321:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971874.668349:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4be12f800/0xbd3388eaa6f4a685 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a67e expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.668389:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4be12f800/0xbd3388eaa6f4a685 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a67e expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.668403:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4be12f800/0xbd3388eaa6f4a685 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a67e expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.668426:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4be12f800, rc 0) 00000100:00100000:0.0:1790971874.668569:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+13:15102:x1877969766276864:12345-0@lo:101:mount.lustre.0 Request processed in 279us (7374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971874.668578:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790971874.668766:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790971874.668805:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a67e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a685 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971874.668816:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a67e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a685 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971874.668843:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790971874.668857:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a67e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a685 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971874.668865:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f200/0xbd3388eaa6f4a67e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a685 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790971874.668899:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790971874.668905:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790971874.668913:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1790971874.668916:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790971874.668949:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f4a68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971874.668958:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f4a68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971874.668967:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f4a68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971874.668992:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790971874.669049:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971874.674211:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766276992 00000100:00100000:3.0:1790971874.674234:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766276992 00000100:00100000:3.0:1790971874.674316:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790971874.674330:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+13:15102:x1877969766276992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971874.674353:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971874.674388:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f4a693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a68c expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.674436:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f4a693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a68c expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.674449:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002dc00/0xbd3388eaa6f4a693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a68c expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.674459:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002dc00, rc 0) 00000100:00100000:1.0:1790971874.674650:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21180 going to sleep for 11 seconds 00000100:00100000:3.0:1790971874.674868:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766276992:12345-0@lo:101:mount.lustre.0 Request processed in 541us (5817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971874.674875:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790971874.674937:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766276992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790971874.674960:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f4a68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a693 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971874.674970:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f4a68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a693 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790971874.678579:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790971874.680603:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790971874.681262:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790971874.681318:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790971874.681351:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790971874.681629:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790971874.681675:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790971874.682066:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790971874.682163:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790971874.682172:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790971874.682436:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971874.682553:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971874.682661:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21600 going to sleep for 11 seconds 00000100:00100000:0.0:1790971874.683679:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766277120 00000100:00100000:0.0:1790971874.683970:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766277120 00000100:00100000:1.0:1790971874.684288:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790971874.684301:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971874.687326:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277120:12345-0@lo:501:mount.lustre.0 Request processed in 3013us (4759us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971874.687345:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790971874.687539:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971874.687611:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971874.687683:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971874.689674:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.693375:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766277248 00000100:00100000:2.0:1790971874.693401:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766277248 00000100:00100000:2.0:1790971874.693520:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790971874.693533:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790971874.696501:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277248:12345-0@lo:503:mount.lustre.0 Request processed in 2941us (8788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.696518:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790971874.698914:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277248:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790971874.703395:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790971874.703907:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790971874.704014:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971874.704059:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4c03f3240 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.705823:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766277376 00000100:00100000:2.0:1790971874.705841:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766277376 00000100:00100000:2.0:1790971874.705921:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790971874.705934:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971874.706359:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277376:12345-0@lo:502:mount.lustre.0 Request processed in 426us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.706377:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790971874.706594:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790971874.706932:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790971874.706995:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790971874.707032:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790971874.707101:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790971874.707141:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790971874.707286:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790971874.707348:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790971874.707378:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790971874.707420:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790971874.707539:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790971874.707579:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790971874.707639:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790971874.707693:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790971874.708556:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971874.708603:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a000 going to sleep for 11 seconds 00000100:00100000:3.0:1790971874.709850:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766277504 00000100:00100000:3.0:1790971874.709868:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766277504 00000100:00100000:3.0:1790971874.709962:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790971874.709973:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790971874.710325:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277504:12345-0@lo:502:mount.lustre.0 Request processed in 353us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971874.710334:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790971874.711350:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790971874.711571:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790971874.711589:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1790971874.722604:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790971874.722621:0:15116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790971874.722628:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790971874.722631:0:15116:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790971874.722637:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790971874.722659:0:15116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cd495693380) 00000020:00000080:3.0:1790971874.722690:0:15116:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790971874.722703:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790971874.722801:0:15116:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4be09e000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790971874.722810:0:15116:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790971874.722819:0:15116:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd3388eaa6f4a6a1 00010000:00010000:3.0:1790971874.732338:0:15116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1790971874.733622:0:15116:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1790971874.736343:0:15116:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790971874.738545:0:15116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790971874.738561:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971874.738570:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.738573:0:15116:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790971874.738578:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790971874.738582:0:15116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790971874.738584:0:15116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790971874.738585:0:15116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790971874.738587:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790971874.738589:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.738591:0:15116:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790971874.738594:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971874.738597:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.738598:0:15116:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790971874.738602:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790971874.738605:0:15116:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790971874.738607:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971874.738610:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.738621:0:15116:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790971874.738626:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971874.738629:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.738632:0:15116:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790971874.738636:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790971874.738740:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971874.738744:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.738745:0:15116:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790971874.738749:0:15116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1790971874.740847:0:15102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1790971874.740902:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790971874.740927:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f4a68c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a693 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.740943:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd494935a00/0xbd3388eaa6f4a68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a693 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971874.740967:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4be09e000 from 1 10000000:01000000:2.0:1790971874.740970:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971874.741021:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.741031:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.741045:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971874.741077:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790971874.741165:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.741228:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49573c840 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.741870:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766277632 00000100:00100000:2.0:1790971874.741882:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766277632 00000100:00100000:2.0:1790971874.741976:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790971874.741988:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+14:15102:x1877969766277632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790971874.742005:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971874.742029:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a6a8 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.742060:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 15 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.742073:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 15 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.742082:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f800, rc 0) 00000100:00100000:2.0:1790971874.742146:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766277632:12345-0@lo:101:mount.lustre.0 Request processed in 159us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.742153:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790971874.746602:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971874.746655:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.746669:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790971874.754059:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790971874.756091:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790971874.756811:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790971874.756871:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790971874.756940:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790971874.756951:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790971874.757073:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971874.757164:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971874.757341:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.757400:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766277760 00000100:00100000:2.0:1790971874.757420:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766277760 00000100:00100000:2.0:1790971874.757647:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790971874.757659:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766277760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971874.757958:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766277760:12345-0@lo:501:mount.lustre.0 Request processed in 299us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.757968:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790971874.758193:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790971874.758245:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790971874.758293:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971874.758325:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd38670a000 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.758442:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766277888 00000100:00100000:2.0:1790971874.758449:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766277888 00000100:00100000:2.0:1790971874.758512:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790971874.758523:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766277888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790971874.758768:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766277888:12345-0@lo:503:mount.lustre.0 Request processed in 244us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.758777:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790971874.758916:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766277888:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790971874.759632:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790971874.759793:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790971874.759861:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971874.759934:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21000 going to sleep for 11 seconds 00000100:00100000:0.0:1790971874.760099:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278016 00000100:00100000:0.0:1790971874.760106:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278016 00000100:00100000:0.0:1790971874.760190:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790971874.760200:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766278016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790971874.760420:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766278016:12345-0@lo:502:mount.lustre.0 Request processed in 213us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971874.760427:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790971874.760558:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790971874.760861:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790971874.760915:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790971874.760979:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790971874.761019:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790971874.761051:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790971874.761100:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790971874.761147:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790971874.761182:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790971874.761218:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790971874.761271:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971874.762424:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21000 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.762590:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278144 00000100:00100000:2.0:1790971874.762613:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278144 00000100:00100000:2.0:1790971874.762660:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790971874.762668:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766278144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971874.763063:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766278144:12345-0@lo:502:mount.lustre.0 Request processed in 393us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.763073:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790971874.763196:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790971874.763385:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790971874.763402:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790971874.764693:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971874.764773:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.764776:0:15120:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790971874.764785:0:15120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4be09e000 00000020:00000080:1.0:1790971874.764787:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971874.764796:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971874.764798:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.764799:0:15120:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790971874.764802:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971874.764804:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.764805:0:15120:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790971874.764808:0:15120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4be09e000 00000020:00000080:1.0:1790971874.764810:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971874.764874:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971874.764877:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.764878:0:15120:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790971874.764881:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971874.764883:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.764884:0:15120:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790971874.764887:0:15120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cd4be09e000 00000020:00000080:1.0:1790971874.764889:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971874.764919:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971874.764922:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971874.764923:0:15120:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790971874.764933:0:15120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790971874.776904:0:15102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790971874.776961:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790971874.776993:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.777011:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790971874.777076:0:15102:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790971874.777079:0:15102:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cd4be09e000 10000000:01000000:3.0:1790971874.777083:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cd4be09e000 10000000:01000000:3.0:1790971874.777089:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790971874.777097:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4be09e000 from 1 10000000:01000000:3.0:1790971874.777100:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790971874.777149:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f4a6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.777159:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f4a6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.777183:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f4a6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971874.777213:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790971874.777312:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971874.777359:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.779901:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278272 00000100:00100000:2.0:1790971874.779918:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278272 00000100:00100000:2.0:1790971874.779992:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790971874.780005:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766278272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790971874.780025:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971874.780044:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a6bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a6b6 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.780075:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6b6 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.780087:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5e600/0xbd3388eaa6f4a6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6b6 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.780096:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e600, rc 0) 00000100:00100000:2.0:1790971874.780175:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278272:12345-0@lo:101:mount.lustre.0 Request processed in 174us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.780182:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790971874.780679:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971874.780728:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f4a6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6bd expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.780743:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f4a6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a6bd expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790971874.781757:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1790971874.782594:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790971874.785622:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790971874.787317:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790971874.787393:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790971874.787509:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790971874.787549:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790971874.787595:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790971874.787631:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790971874.787666:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790971874.791842:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790971874.791938:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790971874.791998:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790971874.792120:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790971874.792205:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790971874.792275:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790971874.792356:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790971874.792429:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790971874.792464:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790971874.792544:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790971874.792583:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790971874.792622:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790971874.792688:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790971874.792762:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790971874.792801:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790971874.792848:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790971874.792899:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790971874.792928:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790971874.792977:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790971874.793010:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790971874.793113:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790971874.793122:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1790971874.793271:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971874.793369:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971874.793461:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278400 00000100:00100000:3.0:1790971874.793499:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278400 00000100:00100000:3.0:1790971874.793565:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790971874.793577:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971874.793853:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278400:12345-0@lo:501:mount.lustre.0 Request processed in 278us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971874.793861:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790971874.793918:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971874.793946:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971874.793990:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971874.794041:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971874.794071:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278528 00000100:00100000:3.0:1790971874.794076:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278528 00000100:00100000:3.0:1790971874.794113:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790971874.794123:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971874.794302:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278528:12345-0@lo:503:mount.lustre.0 Request processed in 181us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971874.794318:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790971874.794355:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4887a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971874.794367:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278528:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790971874.803102:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790971874.803241:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971874.803349:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.803397:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.813832:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278656 00000100:00100000:2.0:1790971874.813851:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278656 00000100:00100000:2.0:1790971874.813914:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790971874.813925:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971874.814329:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278656:12345-0@lo:502:mount.lustre.0 Request processed in 403us (10978us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.814339:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790971874.814446:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790971874.814951:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790971874.815021:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790971874.815058:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790971874.815129:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790971874.816312:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790971874.816490:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790971874.816527:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790971874.816556:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790971874.816599:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790971874.816630:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790971874.816662:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790971874.819619:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790971874.819776:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790971874.819815:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790971874.819870:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790971874.819902:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790971874.819933:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790971874.819977:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790971874.820010:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790971874.820040:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790971874.820087:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790971874.820155:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790971874.820214:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790971874.820267:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790971874.820305:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790971874.820342:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790971874.820392:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790971874.820436:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790971874.820465:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790971874.820535:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790971874.820564:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790971874.820590:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790971874.820616:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790971874.820654:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790971874.820682:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790971874.820739:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790971874.820774:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790971874.820815:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790971874.820879:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790971874.820911:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790971874.820974:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971874.821070:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.821129:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971874.821279:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278784 00000100:00100000:2.0:1790971874.821290:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278784 00000100:00100000:2.0:1790971874.821342:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790971874.821351:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971874.821652:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766278784:12345-0@lo:502:mount.lustre.0 Request processed in 301us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.821661:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790971874.821732:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766278784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790971874.821825:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790971874.821847:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790971874.827549:0:15125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790971874.827579:0:15125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cd4be043380) 00000020:00000080:1.0:1790971874.827615:0:15125:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1790971874.827825:0:15125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4be09e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790971874.827830:0:15125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4be09e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790971874.827833:0:15125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4be09e000 3 00010000:00080000:1.0:1790971874.827871:0:15125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd485294800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1790971874.836693:0:15125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1790971874.837459:0:15125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790971874.837538:0:15125:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790971874.837560:0:15125:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbd3388eaa6f4a6cb 00000100:00080000:2.0:1790971874.837577:0:15125:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790971874.837597:0:15125:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cd485294800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1790971874.837656:0:15125:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4bdda1500 x1877969766278912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790971874.837684:0:15125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790971874.837957:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766278912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790971874.838054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971874.838133:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766278912 00000100:00100000:0.0:1790971874.838152:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766278912 00000100:00100000:0.0:1790971874.838197:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971874.838206:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1877969766278912:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790971874.838238:0:14419:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:0.0:1790971874.838293:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbd3388eaa6f4a6d2 00000004:00100000:0.0:1790971874.838311:0:14419:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790971874.838351:0:14419:0:(import.c:65:import_set_state_nolock()) ffff8cd49fde3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971874.838434:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877969766278912:12345-0@lo:38:llog_process_th.0 Request processed in 226us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971874.838441:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790971874.838507:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cd4bdda1500 x1877969766278912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790971884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971874.838518:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790971874.838527:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790971874.838535:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790971874.838541:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790971874.838543:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd485294800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790971874.838549:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1877969766278912:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790971874.839673:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790971874.839685:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790971874.839688:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790971874.839702:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790971874.840932:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790971874.840961:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766279040:0@lo:400:kworker.0 00000100:00100000:1.0:1790971874.841049:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971874.841112:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279040 00000100:00100000:1.0:1790971874.841122:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279040 00000100:00100000:1.0:1790971874.841879:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790971874.841897:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766279040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971874.841991:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766279040:12345-0@lo:400:kworker.0 Request processed in 99us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971874.841999:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790971874.842064:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cd4a66b7100 x1877969766279040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971874.842082:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766279040:0@lo:400:kworker.0 00000040:00080000:3.0:1790971874.842919:0:15125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1790971874.843253:0:15102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790971874.843299:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790971874.843328:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f4a6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6bd expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.843341:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ca00/0xbd3388eaa6f4a6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6bd expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790971874.843399:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790971874.843403:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971874.843405:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971874.843424:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971874.843425:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971874.843427:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971874.843428:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971874.843431:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971874.843432:0:15102:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790971874.843436:0:15102:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790971874.843439:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790971874.843440:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971874.843441:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971874.843442:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971874.843452:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971874.843453:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971874.843454:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971874.843455:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971874.843456:0:15102:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790971874.843510:0:15102:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790971874.843530:0:15102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766279168:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790971874.843596:0:15102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.843633:0:15102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4957d6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971874.847547:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279168 00000100:00100000:1.0:1790971874.847597:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279168 00000100:00100000:1.0:1790971874.847692:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790971874.847704:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:15102:x1877969766279168:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790971874.847752:0:14414:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790971874.847774:0:14414:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790971874.926307:0:14414:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790971874.926325:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790971874.927494:0:14435:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790971874.927502:0:14435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790971874.927534:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.927559:0:14435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.927569:0:14435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.927620:0:14435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.927639:0:14435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 16 pid: 14413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971874.927655:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14435:1877969766279296:0@lo:104: 00000100:00100000:2.0:1790971874.927748:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.927884:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886ef600 going to sleep for 11 seconds 00000100:00100000:1.0:1790971874.928520:0:14403:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279296 00000100:00100000:1.0:1790971874.928533:0:14403:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279296 00000100:00100000:1.0:1790971874.928601:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790971874.928613:0:14403:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e841c93-8375-413d-802b-5f81a8a5481c+3:14435:x1877969766279296:12345-0@lo:104: 00010000:00010000:1.0:1790971874.928630:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971874.928792:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790971874.928799:0:14403:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6e841c93-8375-413d-802b-5f81a8a5481c+3:14435:x1877969766279296:12345-0@lo:104: Request processed in 189us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971874.928808:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790971874.928969:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971874.928981:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.928991:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971874.928996:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.929009:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971874.929041:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971874.929051:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971874.929105:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.929113:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971874.929141:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.929149:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002ce00/0xbd3388eaa6f4a63f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a646 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971874.929175:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971874.929177:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971874.929179:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971874.929204:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e841c93-8375-413d-802b-5f81a8a5481c:3303:1877969766279424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790971874.929248:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971874.929925:0:14406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279424 00000100:00100000:2.0:1790971874.929934:0:14406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279424 00010000:00010000:2.0:1790971874.929964:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 17 pid: 14413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971874.930019:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790971874.930028:0:14406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e841c93-8375-413d-802b-5f81a8a5481c+17:3303:x1877969766279424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790971874.930044:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971874.930061:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 17 pid: 14413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930074:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 17 pid: 14413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930096:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930105:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790971874.930123:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002621250s 00010000:00010000:2.0:1790971874.930129:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930137:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930146:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930153:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930159:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971874.930171:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930181:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930191:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971874.930203:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971874.930259:0:14406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e841c93-8375-413d-802b-5f81a8a5481c+17:3303:x1877969766279424:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971874.930268:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971874.931119:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e841c93-8375-413d-802b-5f81a8a5481c:3303:1877969766279424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790971874.933600:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4a63f expref: 16 pid: 14413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971874.933628:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14435:1877969766279296:0@lo:104: 00010000:00010000:3.0:1790971874.933662:0:14435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.933674:0:14435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.933681:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971874.933688:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a6d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971874.948215:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+15:15102:x1877969766279168:12345-0@lo:253:mount.lustre.0 Request processed in 100499us (104604us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971874.948234:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790971874.948451:0:15102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15102:1877969766279168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790971874.948521:0:15102:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790971874.948525:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790971874.948527:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790971874.948529:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971874.948531:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971874.948532:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971874.948534:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971874.948536:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971874.948538:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971874.948540:0:15102:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790971874.948560:0:15102:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790971874.954961:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790971874.955114:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790971874.955273:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790971874.955435:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790971874.955633:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790971874.955846:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790971874.963762:0:15102:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790971875.121565:0:15102:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790971875.121574:0:15102:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790971875.121615:0:15102:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790971875.121672:0:15102:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790971875.121689:0:15102:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790971875.121731:0:15102:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790971875.188717:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971876.198103:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790971876.452862:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790971876.452869:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd485573800 from 7 10000000:01000000:0.0:1790971876.452873:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790971876.452918:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971876.452929:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971876.452950:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971876.452976:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766279552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971876.453042:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971876.453105:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49feec900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971876.453240:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279552 00000100:00100000:1.0:1790971876.453249:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279552 00000100:00100000:1.0:1790971876.453302:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790971876.453311:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+15:14416:x1877969766279552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971876.453326:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971876.453339:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a6e0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971876.453362:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971876.453384:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971876.453393:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd494934c00, rc 0) 00000100:00100000:1.0:1790971876.453447:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+16:14416:x1877969766279552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971876.453454:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790971876.453515:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766279552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971876.453529:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971876.453538:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971876.453589:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766279680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790971876.453622:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971876.453642:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483127f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971876.453671:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279680 00000100:00100000:1.0:1790971876.453675:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279680 00000100:00100000:1.0:1790971876.453697:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790971876.453704:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:14416:x1877969766279680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790971876.453718:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790971876.453737:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790971876.453740:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1790971876.453812:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:14416:x1877969766279680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971876.453827:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790971876.453857:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766279680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790971876.453915:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790971876.453923:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971876.453930:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971877.222521:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971878.244822:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971879.271656:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971880.293318:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790971880.301672:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790971880.301681:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790971880.301684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790971880.301688:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790971880.301774:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e841c93-8375-413d-802b-5f81a8a5481c:3304:1877969766279808:0@lo:400:kworker.0 00000100:00100000:2.0:1790971880.301876:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971880.301939:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971880.301945:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766279936:0@lo:400:kworker.0 00000100:00100000:2.0:1790971880.301985:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971880.302017:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766280064:0@lo:400:kworker.0 00000100:00100000:2.0:1790971880.302046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971880.302494:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279936 00000100:00100000:0.0:1790971880.302505:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279936 00000100:00100000:0.0:1790971880.302564:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280064 00000100:00100000:0.0:1790971880.302568:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280064 00000100:00100000:0.0:1790971880.302602:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971880.302612:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766279936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971880.302692:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766279936:12345-0@lo:400:kworker.0 Request processed in 81us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971880.302701:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971880.302721:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971880.302728:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971880.302763:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766280064:12345-0@lo:400:kworker.0 Request processed in 35us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971880.302770:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790971880.302806:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790971880.302842:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bdda1180 x1877969766280064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971880.302862:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766280064:0@lo:400:kworker.0 00010000:00080000:0.0:1790971880.302913:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bdda0a80 x1877969766279936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971880.302924:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766279936:0@lo:400:kworker.0 00000100:00100000:1.0:1790971880.304315:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766279808 00000100:00100000:1.0:1790971880.305500:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766279808 00000100:00100000:1.0:1790971880.305586:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790971880.305597:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:3304:x1877969766279808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971880.305723:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:3304:x1877969766279808:12345-0@lo:400:kworker.0 Request processed in 128us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971880.305731:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790971880.316584:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e841c93-8375-413d-802b-5f81a8a5481c:3304:1877969766279808:0@lo:400:kworker.0 00010000:00010000:1.0:1790971881.317818:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790971881.653978:0:15471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790971882.365577:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971883.366548:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790971883.689508:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790971884.390989:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790971885.415576:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790971885.415582:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790971885.415585:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790971885.415587:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790971885.415626:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e841c93-8375-413d-802b-5f81a8a5481c:3303:1877969766280192:0@lo:400:kworker.0 00000100:00100000:3.0:1790971885.415688:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790971885.415882:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971885.415899:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766280320:0@lo:400:kworker.0 00000100:00100000:0.0:1790971885.416300:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971885.416342:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280320 00000100:00100000:0.0:1790971885.416350:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280320 00000100:00100000:0.0:1790971885.416398:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790971885.416407:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766280320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971885.416466:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766280320:12345-0@lo:400:kworker.0 Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971885.416493:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790971885.416560:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280192 00000100:00100000:0.0:1790971885.416564:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280192 00000100:00100000:0.0:1790971885.416588:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790971885.416593:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+16:3303:x1877969766280192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971885.416623:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+16:3303:x1877969766280192:12345-0@lo:400:kworker.0 Request processed in 29us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971885.416629:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790971885.416657:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766280448:0@lo:400:kworker.0 00000100:00100000:0.0:1790971885.416681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971885.416713:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280448 00000100:00100000:0.0:1790971885.418633:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280448 00000100:00100000:0.0:1790971885.418695:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971885.418705:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766280448:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790971885.418886:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971885.419426:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766280448:12345-0@lo:400:kworker.0 Request processed in 721us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971885.419436:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790971885.420439:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6e841c93-8375-413d-802b-5f81a8a5481c:3303:1877969766280192:0@lo:400:kworker.0 00010000:00080000:3.0:1790971885.420780:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd495ace680 x1877969766280320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971885.420794:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766280320:0@lo:400:kworker.0 00010000:00080000:3.0:1790971885.420827:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd495acd500 x1877969766280448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971885.420836:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766280448:0@lo:400:kworker.0 00000100:00100000:1.0:1790971886.117929:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790971871/real 1790971871] req@ffff8cd4a66b6d80 x1877969766276224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971886 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971886.117962:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cd4a66b6d80 x1877969766276224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971886 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971886.117995:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790971871/real 1790971871] req@ffff8cd4a66b5c00 x1877969766276352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971886 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971886.118010:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cd4a66b5c00 x1877969766276352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790971886 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790971886.118029:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4835cc800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790971886.118052:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790971886.118056:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766276224:0@lo:8:kworker.0 00000100:00080000:1.0:1790971886.118062:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790971886.118067:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790971886.118069:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766276352:0@lo:8:kworker.0 00000100:00080000:2.0:1790971886.118264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790971886.118269:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790971886.118271:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cd4835cc800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790971886.118277:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00100000:0.0:1790971886.118418:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766280576:0@lo:400:kworker.0 00000100:00100000:0.0:1790971886.118496:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971886.118552:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280576 00000100:00100000:0.0:1790971886.118559:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280576 00000100:00100000:0.0:1790971886.118598:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790971886.118607:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48db64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+16:3302:x1877969766280576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971886.118654:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48db64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+16:3302:x1877969766280576:12345-0@lo:400:kworker.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971886.118661:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790971886.118700:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766280576:0@lo:400:kworker.0 00000100:00080000:2.0:1790971886.118866:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790971886.118875:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cd4835cc800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1790971886.118897:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4bdda3480 x1877969766280704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790971886.118920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790971886.118923:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790971886.118925:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790971886.118928:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1790971886.118931:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790971886.118942:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cd49633d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1790971886.118956:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd4bdda1c00 x1877969766280832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790971886.119006:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766281088:0@lo:400:kworker.0 00000100:00100000:2.0:1790971886.119037:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971886.119100:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766280960:0@lo:400:kworker.0 00000100:00100000:0.0:1790971886.119125:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971886.119240:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281088 00000100:00100000:0.0:1790971886.119244:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281088 00000100:00100000:0.0:1790971886.119271:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280960 00000100:00100000:0.0:1790971886.119274:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280960 00000100:00100000:0.0:1790971886.119415:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971886.119423:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766281088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971886.119463:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766281088:12345-0@lo:400:kworker.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971886.119525:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971886.119540:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790971886.119546:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766280960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971886.119581:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766280960:12345-0@lo:400:kworker.0 Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971886.119586:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790971886.119613:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bdda1f80 x1877969766281088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971886.119624:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766281088:0@lo:400:kworker.0 00010000:00080000:0.0:1790971886.119644:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bdda0e00 x1877969766280960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971886.119652:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766280960:0@lo:400:kworker.0 00000100:00100000:3.0:1790971886.119727:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766280704:0@lo:8:kworker.0 00000100:00100000:3.0:1790971886.119762:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971886.119786:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766280832:0@lo:8:kworker.0 00000100:00100000:3.0:1790971886.119805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971886.119913:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280704 00000100:00100000:0.0:1790971886.119917:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280704 00000100:00100000:0.0:1790971886.119971:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766280832 00000100:00100000:0.0:1790971886.119975:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766280832 00000100:00100000:3.0:1790971886.124506:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971886.124518:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3301:x1877969766280704:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790971886.124563:0:15106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1790971886.124592:0:15106:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f4a6ee 00002000:00100000:3.0:1790971886.124607:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cd4883e9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790971886.124612:0:15106:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790971886.124615:0:15106:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790971886.124942:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790971886.124969:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8cd4883ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790971886.125062:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877969766280704:12345-0@lo:8:kworker.0 Request processed in 544us (5298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971886.125070:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971886.125092:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971886.125097:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3301:x1877969766280832:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790971886.125108:0:15106:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1790971886.128759:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4bdda3480 x1877969766280704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790971906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971886.128774:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790971886.128784:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790971886.128793:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790971886.128799:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790971886.128802:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd4835cc800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790971886.128818:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790971886.128825:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766280704:0@lo:8:kworker.0 00000004:00080000:1.0:1790971886.128860:0:14441:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790971886.129287:0:14441:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465068815700ns, next at 0ns, rc = 0 00000004:00080000:1.0:1790971886.132665:0:14442:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790971886.132694:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14442:1877969766281344:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790971886.132768:0:14442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971886.133347:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971886.133363:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766281216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971886.133400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971886.134526:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971886.134926:0:15104:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790971886.134935:0:15104:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790971886.135125:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281344 00000100:00100000:2.0:1790971886.135142:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281344 00000100:00100000:0.0:1790971886.135401:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971886.135411:0:15671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14442:x1877969766281344:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1790971886.144940:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1790971886.149667:0:15671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790971886.149677:0:15671:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1790971886.149683:0:15671:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1790971886.159748:0:15107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281216 00000100:00100000:3.0:1790971886.159759:0:15107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281216 00000100:00100000:3.0:1790971886.159809:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971886.159819:0:15107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766281216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971886.159854:0:15107:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971886.159942:0:15107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1877969766281216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (26540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971886.159949:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790971886.159998:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cd4a66b5c00 x1877969766281216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971886.160019:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766281216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971886.160078:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3301:x1877969766280832:12345-0@lo:8:kworker.0 Request processed in 34979us (40270us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790971886.160092:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790971886.160122:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790971886.160128:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790971886.161388:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766280832:0@lo:8:kworker.0 00002000:00010000:1.0:1790971886.181176:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.181189:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.181208:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.181213:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.181221:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.181239:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.181249:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.181258:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.181280:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.182269:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.183077:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.183105:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934a00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.183111:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.183122:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.183142:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.183150:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75c7c72/0xbd3388eaa6f4a6f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.183173:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.183175:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.183177:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.185826:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.185839:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.185856:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.185860:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.185866:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.185879:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.185897:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.185906:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.185943:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.185957:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.185962:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.186082:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.186087:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.186096:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.186111:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.186119:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cab73fac/0xbd3388eaa6f4a6fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.186137:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.186145:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.186147:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.187263:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.187272:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187363:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.187368:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.187373:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187384:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187393:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187401:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187423:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.187436:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.187440:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187448:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935c00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.187451:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187494:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187508:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187515:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099b3fd6f/0xbd3388eaa6f4a703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.187533:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.187535:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.187537:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.188618:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.188627:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188638:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.188642:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.188646:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188657:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188665:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188681:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188695:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.188705:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.188710:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188717:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.188721:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188729:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188741:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188748:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000540518cd/0xbd3388eaa6f4a70a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.188763:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.188765:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.188767:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.191144:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.191163:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191179:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.191184:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.191190:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191205:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191215:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191223:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191244:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.191257:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.191263:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191271:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.191276:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191293:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191317:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191323:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e53676/0xbd3388eaa6f4a711 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191352:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.191354:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.191355:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.191814:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.191821:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191831:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.191835:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.191839:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191849:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191858:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191866:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.191892:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.191901:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.191906:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192156:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494935200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.192161:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192172:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192184:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192191:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025ee1725/0xbd3388eaa6f4a718 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192209:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.192211:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.192213:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.192860:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.192868:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192877:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.192887:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.192892:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192903:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.192910:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193056:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193076:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.193088:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.193092:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193100:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd494934e00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.193103:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193112:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193125:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193147:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579a06f2/0xbd3388eaa6f4a71f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193165:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.193167:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.193169:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.193870:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.193877:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193887:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.193891:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.193896:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193906:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193925:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193934:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.193949:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.193958:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.194259:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.194270:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42e00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.194274:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.194351:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.194364:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.194371:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.194388:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.194390:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.194392:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790971886.213697:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.213710:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.213728:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.213733:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.213740:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.213759:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.213770:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.213778:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.213844:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790971886.214741:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.214755:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.214767:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.214771:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.214775:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.214787:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.214796:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.214804:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.214821:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790971886.215517:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790971886.215525:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215534:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.215538:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790971886.215549:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.215555:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215559:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.215564:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.215567:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.215570:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215575:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.215579:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215583:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b768/0xbd3388eaa6f4a72d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.215592:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.215598:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215601:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.215604:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.215606:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.215611:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ee00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.215614:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215621:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215631:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215638:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d39386b/0xbd3388eaa6f4a734 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215659:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.215663:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215669:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.215672:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215680:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215691:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215698:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a61e6e2/0xbd3388eaa6f4a73b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.215709:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.215711:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.215712:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.215720:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790971886.216015:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.216021:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.216030:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.216034:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.216038:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.216047:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.216055:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.216063:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.216097:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.216277:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.216283:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.216290:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fa00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.216299:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.216307:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.216318:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.216335:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a45ae88c/0xbd3388eaa6f4a742 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.216351:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.216352:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.216354:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790971886.217020:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.217027:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217036:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.217039:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.217043:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217051:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217059:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217066:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217080:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971886.217088:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971886.217092:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217099:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ea00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971886.217107:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217115:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217126:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217641:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f6a4db/0xbd3388eaa6f4a749 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.217657:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.217659:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.217661:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790971886.219996:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.220008:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.220023:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.220028:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.220034:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.220048:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.220057:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.220072:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.220099:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790971886.220364:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971886.220371:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.220381:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971886.220385:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.220394:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.220415:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.220423:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1066d3c/0xbd3388eaa6f4a750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.220456:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.220458:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.220460:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790971886.220965:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.220971:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.220982:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.220985:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.220989:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.220998:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.221005:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.221012:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.221030:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790971886.221062:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.221069:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.221077:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.221080:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.221089:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.221101:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.221114:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c6dd962/0xbd3388eaa6f4a757 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.221129:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.221131:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.221133:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790971886.222506:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1790971886.223719:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790971886.223730:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.223754:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790971886.223759:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971886.223765:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.223779:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.223789:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.223797:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.223821:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790971886.223870:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971886.223888:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.223899:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971886.223903:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.223915:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.223933:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.223940:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008820e571/0xbd3388eaa6f4a75e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.223962:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.223966:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.223968:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.226300:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.226314:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.226437:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.226442:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.226448:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.226461:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.226505:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.226514:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.226540:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790971886.226594:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971886.226603:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.226613:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42e00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971886.226618:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.226643:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.226660:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.226667:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006116b6c6/0xbd3388eaa6f4a765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.226687:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.226689:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.226691:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.230180:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.230209:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.230227:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.230232:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.230239:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.230254:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.230266:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.230275:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.230306:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790971886.230384:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971886.230392:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.230401:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971886.230406:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.230417:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.230434:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.230455:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066fb0897/0xbd3388eaa6f4a76c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.230507:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.230509:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.230511:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.231276:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.231284:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.231295:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.231299:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.231303:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.231312:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.231342:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.231351:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.231569:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790971886.232106:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790971886.232114:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.232124:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:3.0:1790971886.232128:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.232138:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.232154:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.232161:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5b8b56e/0xbd3388eaa6f4a773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971886.232185:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.232188:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971886.232190:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.234117:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.234131:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.234149:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.234153:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.234158:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.234172:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.234183:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.234192:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.234232:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971886.234270:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971886.234276:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.234284:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971886.234289:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.234298:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.234335:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.234343:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d49b89b/0xbd3388eaa6f4a77a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.234361:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.234363:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.234365:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.237146:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.237161:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.237178:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.237184:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.237190:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.237205:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.237215:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.237224:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.237251:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971886.237335:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971886.237343:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.237351:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42c00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971886.237355:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.237364:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.237379:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.237387:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000968e157e/0xbd3388eaa6f4a781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.237422:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.237434:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.237436:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.240713:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.240727:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.240743:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.240754:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.240761:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.240775:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.240785:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.240794:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.240822:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971886.241351:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971886.241359:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.241368:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43a00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971886.241372:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.241382:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.241398:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.241406:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f76338e/0xbd3388eaa6f4a788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.241431:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.241433:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.241434:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790971886.242751:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971886.242762:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.242776:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790971886.242780:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971886.242786:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.242798:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.242809:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.242826:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.242841:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971886.243235:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971886.243242:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.243271:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971886.243275:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.243285:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.243301:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.243309:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f455d4/0xbd3388eaa6f4a78f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.243339:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.243341:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.243342:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971886.246036:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971886.246048:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.246070:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790971886.246075:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971886.246081:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.246097:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.246107:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.246115:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.246147:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971886.246570:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971886.246578:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.246587:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971886.246592:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.246602:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.246627:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.246636:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a796 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.246656:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.246658:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.246660:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971886.247080:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971886.247087:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.247098:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790971886.247102:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971886.247106:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.247116:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.247336:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.247345:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.247404:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790971886.248085:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971886.248093:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.248104:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790971886.248108:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971886.248112:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.248124:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.248653:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.248664:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.253538:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790971886.253633:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790971886.253642:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253670:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.253676:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253687:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253707:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253714:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a79d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253734:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.253738:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253754:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.253757:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253764:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253774:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253780:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000540d708c/0xbd3388eaa6f4a7a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.253794:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.253795:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.253797:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971886.255643:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971886.255654:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.255670:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790971886.255675:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971886.255681:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.255694:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.255704:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.255713:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.255729:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790971886.256966:0:15671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971886.256976:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.256988:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1790971886.256998:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971886.257003:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.257013:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.257023:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.257030:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971886.257054:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790971886.257243:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790971886.257257:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.257265:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12fa00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971886.257270:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.257279:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.257296:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.257303:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a7ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.257362:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971886.257368:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971886.257377:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.257379:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971886.257381:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.257385:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971886.257388:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.257396:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.257415:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.257421:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d6217b/0xbd3388eaa6f4a7b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971886.257436:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.257437:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971886.257439:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790971886.257700:0:15671:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1790971886.257798:0:15671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14442:x1877969766281344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 122386us (125027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971886.257808:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790971886.257832:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14442:1877969766281344:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790971886.257847:0:14442:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790971886.257893:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14442:1877969766281472:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790971886.257939:0:14442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971886.257994:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495931600 going to sleep for 11 seconds 00000100:00100000:2.0:1790971886.258000:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281472 00000100:00100000:2.0:1790971886.258007:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281472 00000100:00100000:2.0:1790971886.258055:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790971886.258064:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14442:x1877969766281472:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790971886.258101:0:15104:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1790971886.274460:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14442:x1877969766281472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16389us (16513us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790971886.274508:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971886.276818:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14442:1877969766281472:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790971886.276836:0:14442:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1790971886.438567:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971887.465099:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971888.484643:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790971889.306439:0:15823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790971889.306444:0:15823:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790971889.306606:0:15823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cd4aff9f000 00000020:01000004:0.0:1790971889.306623:0:15823:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790971889.306636:0:15823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790971889.306650:0:15823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cd49fdd0000) 00000020:00000080:0.0:1790971889.306668:0:15823:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790971889.342641:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790971889.342908:0:15823:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790971889.343980:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790971889.344278:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790971889.344543:0:15823:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790971889.345092:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 409: rc = 0 00100000:10000000:3.0:1790971889.345247:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 409: rc = 0 00100000:10000000:3.0:1790971889.345394:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 409: rc = 0 00100000:10000000:3.0:1790971889.345872:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 379: rc = 0 00100000:10000000:3.0:1790971889.346346:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 379: rc = 0 00100000:10000000:3.0:1790971889.346647:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 379: rc = 0 00100000:10000000:3.0:1790971889.348578:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 379: rc = 0 00100000:10000000:3.0:1790971889.349342:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 379: rc = 0 00100000:10000000:3.0:1790971889.349808:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 379: rc = 0 00000020:00000080:3.0:1790971889.350856:0:15823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790971889.350868:0:15823:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790971889.350995:0:15823:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd3388eaa6f4a7c0 00000020:01000004:3.0:1790971889.351004:0:15823:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790971889.351026:0:15823:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790971889.351030:0:15823:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790971889.351036:0:15823:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790971889.351057:0:15823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790971889.351060:0:15823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790971889.365101:0:15823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790971889.365192:0:15823:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790971889.365196:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790971889.365202:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971889.365203:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971889.365204:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971889.365205:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971889.365206:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971889.365208:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971889.365210:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971889.365211:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790971889.365214:0:15823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790971889.365216:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790971889.365217:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971889.365218:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971889.365219:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971889.365220:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971889.365221:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971889.365222:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971889.365223:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971889.365224:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790971889.365319:0:15823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790971889.365341:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790971889.365412:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.365535:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971889.369460:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281600 00000100:00100000:0.0:1790971889.369971:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281600 00000100:00100000:1.0:1790971889.371688:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790971889.371699:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:15823:x1877969766281600:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790971889.371752:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790971889.371755:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1790971889.371759:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790971889.383618:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:15823:x1877969766281600:12345-0@lo:253:mount.lustre.0 Request processed in 11912us (18199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971889.383633:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790971889.383656:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790971889.383671:0:15823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790971889.383675:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790971889.383676:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971889.383678:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971889.383679:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971889.383680:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971889.383681:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971889.383683:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971889.383685:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971889.383686:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790971889.383706:0:15823:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cd4aff9f000 from lustre-OST0001 10000000:01000000:3.0:1790971889.383752:0:15823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790971889.383755:0:15823:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790971889.383766:0:15823:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cd4be2a19c0 local copy 00010000:00010000:3.0:1790971889.383783:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971889.384011:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971889.384050:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.384089:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971889.384199:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281728 00000100:00100000:1.0:1790971889.384211:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281728 00000100:00100000:1.0:1790971889.384247:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790971889.384254:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:15823:x1877969766281728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971889.384709:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:15823:x1877969766281728:12345-0@lo:501:mount.lustre.0 Request processed in 453us (656us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790971889.384716:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790971889.391944:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281728:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790971889.399019:0:15823:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790971889.399423:0:15823:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790971889.399434:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.399446:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4a002c400/0xbd3388eaa6f4a566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a56d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971889.399543:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cd4aff9f000 10000000:01000000:2.0:1790971889.399612:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790971889.399619:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790971889.399622:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790971889.399625:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790971889.399628:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790971889.399663:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.399672:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.399695:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971889.399718:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790971889.399780:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971889.399893:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790971889.400321:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281856 00000100:00100000:1.0:1790971889.400330:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281856 00000100:00100000:1.0:1790971889.400382:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790971889.400391:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:15823:x1877969766281856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790971889.400404:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971889.400418:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f4a7ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a7c7 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971889.400445:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f4a7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a7c7 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971889.400456:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43200/0xbd3388eaa6f4a7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a7c7 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971889.400465:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43200, rc 0) 00000100:00100000:1.0:1790971889.400738:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766281856:12345-0@lo:101:mount.lustre.0 Request processed in 348us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.400746:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790971889.400828:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790971889.400844:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7ce expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.400852:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a7ce expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790971889.401824:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790971889.408557:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790971889.408827:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790971889.408872:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790971889.408905:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790971889.408954:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790971889.408988:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790971889.409013:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790971889.409061:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790971889.409068:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790971889.409154:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790971889.409217:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.409261:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790971889.409340:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766281984 00000100:00100000:2.0:1790971889.409348:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766281984 00000100:00100000:2.0:1790971889.409399:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790971889.409409:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766281984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971889.412785:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766281984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971889.412852:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790971889.412910:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.416022:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766281984:12345-0@lo:501:mount.lustre.0 Request processed in 3585us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971889.416038:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790971889.416497:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49fe900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971889.416565:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766282112 00000100:00100000:3.0:1790971889.416574:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766282112 00000100:00100000:1.0:1790971889.416651:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790971889.416662:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766282112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790971889.417088:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766282112:12345-0@lo:503:mount.lustre.0 Request processed in 428us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.417105:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790971889.417130:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790971889.421405:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790971889.422272:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790971889.422371:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.422425:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49573c840 going to sleep for 11 seconds 00000100:00100000:1.0:1790971889.422580:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766282240 00000100:00100000:1.0:1790971889.422588:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766282240 00000100:00100000:1.0:1790971889.422638:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790971889.422648:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766282240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790971889.422908:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766282240:12345-0@lo:502:mount.lustre.0 Request processed in 259us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.422917:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790971889.423406:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790971889.423768:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790971889.423824:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790971889.423877:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790971889.423927:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790971889.423965:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790971889.423998:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790971889.424046:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790971889.424083:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790971889.424129:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1790971889.424167:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790971889.424219:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.424245:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49573c840 going to sleep for 11 seconds 00000100:00100000:3.0:1790971889.425387:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766282368 00000100:00100000:3.0:1790971889.425399:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766282368 00000100:00100000:3.0:1790971889.425458:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790971889.425467:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766282368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790971889.425716:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766282368:12345-0@lo:502:mount.lustre.0 Request processed in 249us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971889.425724:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790971889.430567:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790971889.430741:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1790971889.430760:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1790971889.440036:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790971889.440048:0:15824:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790971889.440054:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971889.440057:0:15824:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790971889.440077:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790971889.440093:0:15824:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cd48794cd40) 00000020:00000080:2.0:1790971889.440115:0:15824:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790971889.440121:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790971889.440197:0:15824:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4aff9f000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790971889.440205:0:15824:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790971889.440211:0:15824:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd3388eaa6f4a7dc 00010000:00010000:2.0:1790971889.450223:0:15824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1790971889.451929:0:15824:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1790971889.462288:0:15824:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790971889.468312:0:15824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790971889.468324:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971889.468330:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971889.468332:0:15824:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790971889.468336:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971889.468340:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971889.468342:0:15824:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790971889.468344:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790971889.468347:0:15824:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790971889.468349:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971889.468352:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971889.468353:0:15824:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790971889.468355:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790971889.468358:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971889.468359:0:15824:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790971889.468362:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790971889.468421:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790971889.468424:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790971889.468426:0:15824:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790971889.468430:0:15824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1790971889.471466:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1790971889.471536:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790971889.471564:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7ce expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.471576:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5f000/0xbd3388eaa6f4a7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7ce expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971889.471584:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4aff9f000 from 1 10000000:01000000:0.0:1790971889.471586:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790971889.471621:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.471630:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.471641:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971889.471664:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790971889.471727:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.471762:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49573ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971889.471831:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766282496 00000100:00100000:3.0:1790971889.471839:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766282496 00000100:00100000:3.0:1790971889.471888:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790971889.471897:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:15823:x1877969766282496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790971889.471911:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971889.471923:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a7e3 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.471944:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.471954:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.471962:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c000, rc 0) 00000100:00100000:3.0:1790971889.472001:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766282496:12345-0@lo:101:mount.lustre.0 Request processed in 105us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971889.472007:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790971889.472382:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790971889.472397:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.472405:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790971889.472912:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790971889.473641:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790971889.473874:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790971889.473928:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790971889.473994:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790971889.474002:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790971889.474075:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790971889.474129:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.475687:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49573ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971889.483970:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766282624 00000100:00100000:3.0:1790971889.483985:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766282624 00000100:00100000:1.0:1790971889.484111:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790971889.484120:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766282624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790971889.484453:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766282624:12345-0@lo:501:mount.lustre.0 Request processed in 334us (10325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.484461:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790971889.484765:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790971889.484815:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790971889.484863:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.484899:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49573ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790971889.484948:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766282752 00000100:00100000:1.0:1790971889.484953:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766282752 00000100:00100000:1.0:1790971889.484987:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790971889.484993:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766282752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790971889.485217:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766282752:12345-0@lo:503:mount.lustre.0 Request processed in 223us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.485225:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790971889.485332:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790971889.487207:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790971889.487432:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790971889.487733:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971889.487781:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495931f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790971889.487835:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766282880 00000100:00100000:2.0:1790971889.487843:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766282880 00000100:00100000:2.0:1790971889.487915:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790971889.487925:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766282880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971889.488175:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766282880:12345-0@lo:502:mount.lustre.0 Request processed in 251us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971889.488183:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790971889.488272:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766282880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790971889.488660:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790971889.488720:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790971889.488769:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790971889.488804:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790971889.488838:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790971889.488903:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790971889.488941:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790971889.488975:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790971889.489008:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790971889.489049:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971889.489443:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495931f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971889.489547:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283008 00000100:00100000:0.0:1790971889.489554:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283008 00000100:00100000:1.0:1790971889.489631:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790971889.489639:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766283008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790971889.489822:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766283008:12345-0@lo:502:mount.lustre.0 Request processed in 182us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.489830:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790971889.489914:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790971889.490022:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790971889.490036:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790971889.493554:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971889.493569:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971889.493572:0:15828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790971889.493579:0:15828:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4aff9f000 00000020:00000080:1.0:1790971889.493582:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971889.493589:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971889.493592:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971889.493594:0:15828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790971889.493596:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971889.493599:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971889.493600:0:15828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790971889.493603:0:15828:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cd4aff9f000 00000020:00000080:1.0:1790971889.493621:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971889.493679:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971889.493683:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971889.493684:0:15828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790971889.493686:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790971889.493689:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971889.493690:0:15828:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790971889.493693:0:15828:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cd4aff9f000 00000020:00000080:1.0:1790971889.493695:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790971889.493733:0:15828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790971889.493736:0:15828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790971889.493737:0:15828:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790971889.493740:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790971889.494111:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790971889.494134:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790971889.494148:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.494159:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971889.494204:0:15823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790971889.494207:0:15823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cd4aff9f000 10000000:01000000:2.0:1790971889.494210:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cd4aff9f000 10000000:01000000:2.0:1790971889.494213:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790971889.494219:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cd4aff9f000 from 1 10000000:01000000:2.0:1790971889.494222:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790971889.494330:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.494341:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.494352:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971889.494374:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790971889.494438:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971889.494500:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30780 going to sleep for 11 seconds 00000100:00100000:1.0:1790971889.494576:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283136 00000100:00100000:1.0:1790971889.494583:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283136 00000100:00100000:1.0:1790971889.494625:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790971889.494633:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766283136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790971889.494646:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971889.494658:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f4a7f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a7f1 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971889.494680:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f4a7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a7f1 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971889.494690:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43c00/0xbd3388eaa6f4a7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a7f1 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971889.494699:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43c00, rc 0) 00000100:00100000:1.0:1790971889.494736:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283136:12345-0@lo:101:mount.lustre.0 Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.494742:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790971889.495383:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790971889.495400:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7f8 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971889.495409:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a7f8 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790971889.496033:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1790971889.501648:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790971889.502003:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790971889.502051:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790971889.502084:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790971889.502147:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790971889.502181:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790971889.502225:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790971889.506595:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790971889.506693:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790971889.506773:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790971889.506811:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790971889.506846:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790971889.506896:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790971889.506932:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790971889.506964:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790971889.507010:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790971889.507045:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790971889.507077:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790971889.507143:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790971889.507183:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790971889.507240:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790971889.511969:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790971889.512031:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790971889.512067:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790971889.512140:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790971889.512177:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790971889.512208:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790971889.512252:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790971889.514689:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790971889.514725:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790971889.514795:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1790971889.514832:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1790971889.514866:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1790971889.514900:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1790971889.514948:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1790971889.514985:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1790971889.515056:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1790971889.515093:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1790971889.515179:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1790971889.515186:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1790971889.519443:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971889.519524:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971889.519571:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30780 going to sleep for 11 seconds 00010000:00010000:2.0:1790971889.520797:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971889.522543:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283264 00000100:00100000:2.0:1790971889.522557:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283264 00000100:00100000:2.0:1790971889.522625:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790971889.522635:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971889.522927:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283264:12345-0@lo:501:mount.lustre.0 Request processed in 292us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971889.522935:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790971889.522992:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790971889.523039:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790971889.523093:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971889.523134:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30780 going to sleep for 11 seconds 00000100:00100000:3.0:1790971889.523200:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283392 00000100:00100000:3.0:1790971889.523205:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283392 00000100:00100000:3.0:1790971889.523236:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790971889.523244:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790971889.523525:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283392:12345-0@lo:503:mount.lustre.0 Request processed in 281us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971889.523532:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790971889.524216:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790971889.524846:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790971889.524922:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971889.524985:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971889.525024:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30780 going to sleep for 11 seconds 00000100:00100000:1.0:1790971889.525450:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283520 00000100:00100000:1.0:1790971889.525458:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283520 00000100:00100000:1.0:1790971889.525527:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790971889.525537:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790971889.525850:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283520:12345-0@lo:502:mount.lustre.0 Request processed in 313us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.525857:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790971889.527706:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790971889.528030:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790971889.528088:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790971889.535916:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790971889.536065:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790971889.536161:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790971889.536219:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790971889.536251:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790971889.536633:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790971889.536684:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790971889.536721:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790971889.536757:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790971889.536804:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790971889.536842:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790971889.536877:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790971889.536926:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790971889.536961:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790971889.536996:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790971889.537038:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790971889.537072:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790971889.537114:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790971889.537162:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790971889.537196:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790971889.537227:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790971889.537286:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790971889.538225:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790971889.538577:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790971889.538649:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790971889.538711:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790971889.538780:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790971889.538830:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790971889.538878:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790971889.538914:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790971889.538945:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790971889.538992:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790971889.539028:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790971889.539073:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790971889.539177:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790971889.539216:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790971889.540214:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790971889.540414:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790971889.540467:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790971889.541450:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.541577:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd486b5ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1790971889.546316:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283648 00000100:00100000:2.0:1790971889.546333:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283648 00000100:00100000:2.0:1790971889.546384:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790971889.546395:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790971889.546730:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766283648:12345-0@lo:502:mount.lustre.0 Request processed in 335us (5279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971889.546738:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790971889.546956:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766283648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790971889.547074:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790971889.547090:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790971889.551947:0:15833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790971889.551968:0:15833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cd4879499c0) 00000020:00000080:2.0:1790971889.551995:0:15833:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1790971889.552088:0:15833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cd4aff9f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790971889.552092:0:15833:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cd4aff9f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790971889.552095:0:15833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cd4aff9f000 3 00010000:00080000:2.0:1790971889.552216:0:15833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cd386c4b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1790971889.554686:0:15833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1790971889.554882:0:15833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790971889.554926:0:15833:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790971889.554941:0:15833:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbd3388eaa6f4a806 00000100:00080000:0.0:1790971889.554952:0:15833:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790971889.554963:0:15833:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cd386c4b800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1790971889.555000:0:15833:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd38518d180 x1877969766283776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790971889.555027:0:15833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790971889.555076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790971889.555080:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790971889.555087:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790971889.555091:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1790971889.555095:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1790971889.555206:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766283776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790971889.555293:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.555370:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283776 00000100:00100000:3.0:1790971889.555376:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283776 00000100:00100000:3.0:1790971889.555409:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790971889.555417:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1877969766283776:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790971889.555439:0:14419:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1790971889.555467:0:14419:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbd3388eaa6f4a80d 00000004:00100000:3.0:1790971889.555506:0:14419:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790971889.555537:0:14419:0:(import.c:65:import_set_state_nolock()) ffff8cd4883e9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790971889.555587:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877969766283776:12345-0@lo:38:llog_process_th.0 Request processed in 170us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971889.555604:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790971889.555647:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd38518d180 x1877969766283776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790971899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790971889.555657:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790971889.555663:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1790971889.555669:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790971889.555673:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790971889.555675:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd386c4b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790971889.555680:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1877969766283776:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790971889.555841:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cd49633d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1790971889.555861:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd38518d180 x1877969766284032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790971889.555918:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766283904:0@lo:400:kworker.0 00000100:00100000:0.0:1790971889.555950:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.555971:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790971889.555976:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766284160:0@lo:400:kworker.0 00000100:00100000:0.0:1790971889.555998:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.556022:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790971889.556030:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766284288:0@lo:400:kworker.0 00000100:00100000:0.0:1790971889.556052:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.556072:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284160 00000100:00100000:0.0:1790971889.556076:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284160 00000100:00100000:0.0:1790971889.556173:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284288 00000100:00100000:0.0:1790971889.556177:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284288 00000100:00100000:0.0:1790971889.556212:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790971889.556219:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766284160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971889.556599:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766284160:12345-0@lo:400:kworker.0 Request processed in 225us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971889.556609:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790971889.556628:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971889.556636:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766284288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971889.556673:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1877969766284288:12345-0@lo:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971889.556689:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1790971889.556726:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd38518d880 x1877969766284288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971889.556737:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1877969766284288:0@lo:400:kworker.0 00010000:00080000:0.0:1790971889.556761:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd38518e680 x1877969766284160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971889.556770:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766284160:0@lo:400:kworker.0 00000100:00100000:3.0:1790971889.558249:0:15106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766283904 00000100:00100000:3.0:1790971889.558271:0:15106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766283904 00000100:00100000:3.0:1790971889.558327:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971889.558336:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1877969766283904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790971889.558412:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1877969766283904:12345-0@lo:400:kworker.0 Request processed in 77us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971889.558419:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971889.558461:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766283904:0@lo:400:kworker.0 00000100:00100000:3.0:1790971889.558508:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766284032:0@lo:8:kworker.0 00000100:00100000:3.0:1790971889.558542:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.558579:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284032 00000100:00100000:3.0:1790971889.558583:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284032 00000100:00100000:3.0:1790971889.558602:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790971889.558606:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1877969766284032:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1790971889.558651:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1877969766284032:12345-0@lo:8:kworker.0 Request processed in 43us (108us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790971889.558667:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790971889.558689:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790971889.558695:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790971889.558699:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790971889.558702:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766284032:0@lo:8:kworker.0 00000100:00080000:1.0:1790971889.559381:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790971889.559387:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1790971889.559598:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790971889.559888:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790971889.559917:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790971889.559940:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a7f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7f8 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.559951:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ee00/0xbd3388eaa6f4a7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a7f8 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790971889.559994:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790971889.559997:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971889.559998:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971889.559999:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971889.560000:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971889.560002:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971889.560004:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971889.560006:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971889.560007:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790971889.560011:0:15823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1790971889.560013:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790971889.560015:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790971889.560016:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790971889.560017:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790971889.560018:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790971889.560020:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790971889.560021:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790971889.560022:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790971889.560023:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790971889.560049:0:15823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790971889.560070:0:15823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766284416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790971889.560214:0:15823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.560243:0:15823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd488b339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790971889.560401:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284416 00000100:00100000:2.0:1790971889.560408:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284416 00000100:00100000:2.0:1790971889.560460:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790971889.560494:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:15823:x1877969766284416:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790971889.560521:0:14411:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790971889.560536:0:14411:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790971889.617022:0:14411:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790971889.617073:0:14411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790971889.619670:0:14435:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790971889.619680:0:14435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790971889.619703:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.619722:0:14435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.619732:0:14435:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.619772:0:14435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971889.619788:0:14435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 19 pid: 14413 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971889.619803:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14435:1877969766284544:0@lo:104: 00000100:00100000:3.0:1790971889.619871:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971889.619913:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd48e79bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971889.620033:0:14402:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284544 00000100:00100000:0.0:1790971889.620040:0:14402:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284544 00000100:00100000:0.0:1790971889.620094:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971889.620112:0:14402:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+3:14435:x1877969766284544:12345-0@lo:104: 00010000:00010000:0.0:1790971889.620124:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620178:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790971889.620184:0:14402:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+3:14435:x1877969766284544:12345-0@lo:104: Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971889.620191:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790971889.620212:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971889.620218:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620225:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ee00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:0.0:1790971889.620228:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620265:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790971889.620272:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971889.620278:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790971889.620314:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620319:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790971889.620345:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620352:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4be12ee00/0xbd3388eaa6f4a6e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a6e7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620369:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971889.620371:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971889.620372:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971889.620392:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766284672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790971889.620421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971889.620459:0:14406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284672 00000100:00100000:0.0:1790971889.620462:0:14406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284672 00010000:00010000:0.0:1790971889.620512:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 20 pid: 14413 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971889.620536:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971889.620543:0:14406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e841c93-8375-413d-802b-5f81a8a5481c+20:3305:x1877969766284672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790971889.620560:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971889.620565:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 20 pid: 14413 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620575:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 20 pid: 14413 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620589:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620596:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790971889.620609:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002621250s 00010000:00010000:0.0:1790971889.620614:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620620:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620628:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620635:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620640:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002de00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971889.620645:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620653:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620667:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620677:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971889.620708:0:14406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e841c93-8375-413d-802b-5f81a8a5481c+20:3305:x1877969766284672:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971889.620715:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790971889.620756:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766284672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790971889.620782:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd494934c00/0xbd3388eaa6f4a6e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6e0 expref: 19 pid: 14413 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971889.620791:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14435:1877969766284544:0@lo:104: 00010000:00010000:0.0:1790971889.620803:0:14435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620812:0:14435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620819:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971889.620825:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002de00/0xbd3388eaa6f4a814 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971889.627841:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:15823:x1877969766284416:12345-0@lo:253:mount.lustre.0 Request processed in 67339us (67616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971889.627855:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790971889.628001:0:15823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6e841c93-8375-413d-802b-5f81a8a5481c:15823:1877969766284416:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790971889.628020:0:15823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790971889.628024:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790971889.628026:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790971889.628027:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790971889.628028:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790971889.628029:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790971889.628031:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790971889.628032:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790971889.628034:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790971889.628036:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790971889.628051:0:15823:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790971889.634719:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971889.634879:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790971889.635033:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971889.635334:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790971889.635581:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790971889.635854:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790971889.636762:0:15823:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790971889.707683:0:15823:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790971889.707694:0:15823:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790971889.707731:0:15823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790971889.707794:0:15823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790971889.707807:0:15823:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790971889.707838:0:15823:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790971890.549948:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790971890.638075:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1790971890.638097:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:0.0:1790971891.172884:0:14416:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790971891.172889:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cd485573800 from 8 10000000:01000000:0.0:1790971891.172895:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790971891.172936:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f400/0xbd3388eaa6f4a81b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971891.172954:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f400/0xbd3388eaa6f4a81b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971891.172965:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f400/0xbd3388eaa6f4a81b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971891.172990:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766284800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971891.173054:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971891.173096:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49573c180 going to sleep for 11 seconds 00000100:00100000:3.0:1790971891.175326:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284800 00000100:00100000:3.0:1790971891.175342:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284800 00000100:00100000:3.0:1790971891.175403:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790971891.175413:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bd8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+18:14416:x1877969766284800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971891.175431:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971891.175450:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4a822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a81b expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971891.175504:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4a822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a81b expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971891.175517:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002c600/0xbd3388eaa6f4a822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a81b expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971891.175527:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c600, rc 0) 00000100:00100000:3.0:1790971891.175595:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bd8bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766284800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971891.175602:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790971891.175660:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766284800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971891.175678:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f400/0xbd3388eaa6f4a81b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a822 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971891.175687:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f400/0xbd3388eaa6f4a81b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a822 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971891.175757:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766284928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790971891.176895:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971891.176927:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd487c30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790971891.176941:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766284928 00000100:00100000:3.0:1790971891.176946:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766284928 00000100:00100000:3.0:1790971891.176975:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790971891.176982:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766284928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790971891.176998:0:14411:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790971891.177014:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790971891.177017:0:14411:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790971891.177085:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766284928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971891.177092:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790971891.177129:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766284928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790971891.177182:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790971891.177191:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f400/0xbd3388eaa6f4a81b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a822 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971891.177200:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f400/0xbd3388eaa6f4a81b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a822 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971891.556589:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971891.556621:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766285056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971891.556691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971891.556810:0:15107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285056 00000100:00100000:3.0:1790971891.556820:0:15107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285056 00000100:00100000:3.0:1790971891.556886:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790971891.556896:0:15107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766285056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971891.556931:0:15107:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971891.556985:0:15107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766285056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971891.556993:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790971891.557221:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790971891.557249:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790971891.557272:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766285056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790971892.594827:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971893.606111:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790971893.925325:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1790971894.631382:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790971894.631388:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790971894.631392:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790971894.631407:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cd49633d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1790971894.631427:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cd38518e680 x1877969766285440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1790971894.632012:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971894.633567:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766285568:0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.633640:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971894.633813:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790971894.633821:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766285312:0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.633849:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971894.633889:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766285696:0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.633914:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971894.633932:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790971894.633937:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766285184:0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.633964:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971894.633986:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766285824:0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.634025:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971894.634054:0:15106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285312 00000100:00100000:2.0:1790971894.634062:0:15106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285312 00000100:00100000:2.0:1790971894.634112:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971894.634121:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766285312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.634171:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766285312:12345-0@lo:400:kworker.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971894.634178:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971894.634204:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285568 00000100:00100000:2.0:1790971894.634208:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285568 00000100:00100000:2.0:1790971894.634803:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285696 00000100:00100000:2.0:1790971894.634807:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285696 00000100:00100000:2.0:1790971894.634821:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285824 00000100:00100000:2.0:1790971894.634823:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285824 00000100:00100000:2.0:1790971894.634836:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971894.634841:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766285568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.634878:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1877969766285568:12345-0@lo:400:kworker.0 Request processed in 37us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971894.634885:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971894.634895:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971894.634901:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766285696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.634930:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766285696:12345-0@lo:400:kworker.0 Request processed in 29us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971894.634936:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971894.634945:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790971894.634951:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766285824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.634973:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766285824:12345-0@lo:400:kworker.0 Request processed in 23us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971894.634985:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1790971894.635025:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495664a80 x1877969766285824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971894.635037:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766285824:0@lo:400:kworker.0 00010000:00080000:2.0:1790971894.635047:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd38518c000 x1877969766285696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971894.635053:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766285696:0@lo:400:kworker.0 00000100:00100000:2.0:1790971894.635080:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766285312:0@lo:400:kworker.0 00010000:00080000:2.0:1790971894.635089:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd38518d180 x1877969766285568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790971894.635097:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1877969766285568:0@lo:400:kworker.0 00000100:00100000:0.0:1790971894.635663:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766285440:0@lo:8:kworker.0 00000100:00100000:0.0:1790971894.635702:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971894.635746:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285184 00000100:00100000:0.0:1790971894.635757:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285184 00000100:00100000:0.0:1790971894.635873:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790971894.635881:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766285184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971894.635932:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766285184:12345-0@lo:400:kworker.0 Request processed in 52us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971894.635939:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790971894.635964:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766285184:0@lo:400:kworker.0 00000100:00080000:0.0:1790971894.635968:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971894.635974:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790971894.635987:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285440 00000100:00100000:0.0:1790971894.635991:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285440 00000100:00100000:0.0:1790971894.636015:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790971894.636020:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1877969766285440:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790971894.636041:0:15104:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1790971894.636065:0:15104:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd3388eaa6f4a829 00002000:00100000:0.0:1790971894.636078:0:15104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cd385b23000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790971894.636082:0:15104:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790971894.636085:0:15104:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790971894.636393:0:15104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790971894.636417:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8cd385b24000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971894.636466:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1877969766285440:12345-0@lo:8:kworker.0 Request processed in 445us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971894.636491:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790971894.636523:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd38518e680 x1877969766285440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790971919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790971894.636537:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790971894.636544:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790971894.636548:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790971894.636550:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8cd49633d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790971894.637130:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790971894.637138:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1877969766285440:0@lo:8:kworker.0 00000004:00080000:3.0:1790971894.643971:0:14443:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790971894.644430:0:14443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 473583958947ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790971894.649623:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766285952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971894.649911:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971894.649972:0:15107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766285952 00000100:00100000:0.0:1790971894.649979:0:15107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766285952 00000100:00100000:0.0:1790971894.650025:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971894.650040:0:15107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766285952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790971894.650074:0:15107:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971894.650115:0:15107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766285952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971894.650122:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790971894.650144:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790971894.650166:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495666680 x1877969766285952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790971910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790971894.650183:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766285952:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1790971894.650199:0:14444:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1790971894.651374:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495666680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14444:1877969766286080:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790971894.651420:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971894.651788:0:15106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286080 00000100:00100000:0.0:1790971894.651795:0:15106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286080 00000100:00100000:0.0:1790971894.651839:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971894.651847:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14444:x1877969766286080:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790971894.669026:0:15106:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1790971894.669039:0:15106:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1790971894.669045:0:15106:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:1.0:1790971894.683423:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4879a7780 going to sleep for 11 seconds 00002000:00010000:0.0:1790971894.701354:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.701366:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.701384:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.701388:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.701394:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.701420:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.701430:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.701439:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.701457:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790971894.701962:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.701969:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.701978:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.701981:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.701985:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.701994:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702002:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702021:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702039:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790971894.702433:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.702439:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702448:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.702451:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.702455:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702463:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702495:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702503:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702512:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790971894.702901:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.702908:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702922:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.702925:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.702929:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702938:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702947:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702955:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.702964:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1790971894.708128:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.708142:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.708158:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.708163:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.708169:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.708181:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.708207:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.708231:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.708243:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1790971894.709006:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.709015:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.709024:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.709027:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.709031:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.709040:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.709047:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.709054:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.709073:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1790971894.710966:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.710980:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.710995:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.710999:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.711005:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.711017:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.711027:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.711034:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.711046:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1790971894.713374:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.713390:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.713406:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.713418:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.713424:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.713437:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.713447:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.713456:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.713528:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1790971894.714663:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1790971894.714672:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716612:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.716626:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716642:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716663:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716695:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f2d9f5/0xbd3388eaa6f4a830 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716720:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1790971894.716725:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716731:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.716734:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716742:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716752:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716758:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000540d708c/0xbd3388eaa6f4a837 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716770:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790971894.716773:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716778:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12fa00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.716788:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716796:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716805:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716813:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075ddc759/0xbd3388eaa6f4a83e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716828:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790971894.716832:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716838:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ea00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.716841:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716848:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716858:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716865:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fab312f/0xbd3388eaa6f4a845 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716883:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790971894.716887:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716893:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.716896:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716903:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716912:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716918:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb31fb57/0xbd3388eaa6f4a84c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716928:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790971894.716932:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716938:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.716941:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716959:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716970:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716977:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044e83de2/0xbd3388eaa6f4a853 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.716990:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790971894.716994:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717000:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12fe00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.717003:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717011:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717020:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717026:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f99965c/0xbd3388eaa6f4a85a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717048:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.717051:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717057:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ee00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.717060:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717068:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717077:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717084:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0145df/0xbd3388eaa6f4a861 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717095:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.717096:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.717098:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.717111:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.717592:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.717599:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717611:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.717622:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.717628:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717640:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717649:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717657:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717677:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.717687:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.717691:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717698:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.717702:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717709:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717719:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717736:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e7adabc/0xbd3388eaa6f4a868 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.717749:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.717751:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.717753:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.718174:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.718180:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718188:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.718191:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.718195:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718204:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718212:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718218:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718233:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.718241:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.718251:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718258:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12ec00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.718274:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718282:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718294:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718300:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a6563e4/0xbd3388eaa6f4a86f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718314:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.718316:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.718317:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.718735:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.718741:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718749:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.718752:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.718757:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718777:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718785:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718792:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718808:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.718818:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.718822:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718828:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.718832:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718840:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718851:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718858:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f3e8e4/0xbd3388eaa6f4a876 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.718876:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.718878:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.718880:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.719212:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.719218:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719226:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.719229:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.719233:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719242:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719250:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719258:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719287:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.719295:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.719299:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719317:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12e400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.719320:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719328:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719338:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719346:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e8ea849/0xbd3388eaa6f4a87d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719359:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.719360:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.719362:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.719735:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.719742:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719750:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.719753:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.719757:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719766:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719778:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719785:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719797:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.719804:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.719808:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719814:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.719818:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719825:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719836:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719842:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a884 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.719854:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.719859:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.719861:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.720183:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.720189:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.720197:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.720200:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.720205:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.720213:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.720221:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.720229:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.720240:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.720246:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.720249:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.720256:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.720259:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790971894.724460:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971894.724504:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.724522:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1790971894.724527:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971894.724533:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.724549:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.724560:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.724568:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.724589:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790971894.726566:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790971894.726578:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.726593:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1790971894.726597:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790971894.726604:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.726617:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.726633:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.726641:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.726652:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790971894.729854:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.729876:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.729884:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a88b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.729944:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790971894.729950:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.729958:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42a00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.729961:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.729969:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.729979:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.729986:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001929146/0xbd3388eaa6f4a892 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.730009:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.730013:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.730020:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd43e00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.730023:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.730030:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.730039:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.730045:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000811eb835/0xbd3388eaa6f4a899 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.730057:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.730059:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.730061:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.730066:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.730068:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.730069:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790971894.730962:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1790971894.731626:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.731635:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.731668:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.731673:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.731680:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.731832:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.731843:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.731851:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.731878:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790971894.732342:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.732348:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.732356:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.732359:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.732363:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.732371:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.732388:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.732395:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.732409:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790971894.735137:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.735150:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.735165:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.735169:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.735175:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.735188:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.735198:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.735207:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.735229:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790971894.736826:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790971894.736838:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736850:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7e00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971894.736855:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736865:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736888:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736903:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b3f1e4/0xbd3388eaa6f4a8a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736925:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790971894.736929:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736935:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971894.736939:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736946:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736956:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736964:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4a8a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736975:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971894.736979:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.736986:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971894.736994:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737002:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737012:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737019:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3ceecf2/0xbd3388eaa6f4a8ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737034:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971894.737036:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971894.737037:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.737336:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.737343:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.737353:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.737357:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.737362:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.737373:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.737382:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.737389:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.737413:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971894.737791:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971894.737796:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737804:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6c00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971894.737808:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737816:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737828:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737841:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063104a79/0xbd3388eaa6f4a8b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.737856:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971894.737858:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971894.737860:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.738871:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.738880:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.738892:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.738902:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.738909:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.738921:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.738930:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.738938:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.738998:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790971894.742260:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.742281:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.742298:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.742304:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.742310:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.742324:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.742333:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.742348:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745072:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790971894.745085:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745097:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6e00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971894.745102:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745112:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745131:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745138:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000985b1a28/0xbd3388eaa6f4a8bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745158:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971894.745162:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745176:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7600 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971894.745180:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745187:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745197:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.745204:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971894.745206:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971894.745208:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971894.745802:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.753551:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790971894.753567:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f3756f7/0xbd3388eaa6f4a8c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971894.754415:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.754424:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.754439:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.754444:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.754450:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.754464:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.754501:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.754509:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.755372:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971894.755382:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.755393:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971894.755397:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.755407:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.755425:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.757392:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790971894.757407:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cd7795/0xbd3388eaa6f4a8ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971894.758159:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.758167:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.758180:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.758185:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.758191:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.758204:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971894.758711:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.759392:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.759407:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.759482:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.759494:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.759500:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.759515:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.759520:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.759531:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.759548:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.759555:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003110b4a9/0xbd3388eaa6f4a8d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.759573:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.759574:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.759576:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.760110:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.760116:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.760127:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.760131:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.760135:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.760145:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.760158:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.760164:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.760180:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.760189:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.760193:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.760199:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7000 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.760202:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.760209:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.761382:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.761391:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4a8d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.761408:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.761418:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.761421:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.761979:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.761986:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.761997:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.762001:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.762007:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762018:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762027:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762034:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762057:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790971894.762068:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790971894.762072:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762079:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7400 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971894.762083:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762104:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762116:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762123:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0f42de6/0xbd3388eaa6f4a8df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.762137:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.762139:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971894.762141:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971894.762437:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971894.762440:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971894.762442:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790971894.763869:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790971894.763877:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.763891:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790971894.763895:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971894.763901:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.763913:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.763922:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.763941:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971894.764008:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790971894.764190:0:15106:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1790971894.765438:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14444:x1877969766286080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 113584us (114011us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971894.765449:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790971894.765541:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495666680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14444:1877969766286080:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790971894.765556:0:14444:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1790971894.765600:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495666680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14444:1877969766286208:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790971894.765634:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971894.765671:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd48e79bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790971894.765693:0:15671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286208 00000100:00100000:0.0:1790971894.765699:0:15671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286208 00000100:00100000:0.0:1790971894.765735:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790971894.765742:0:15671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14444:x1877969766286208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790971894.765782:0:15671:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1790971894.769617:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790971894.769632:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.769646:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7a00 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:1.0:1790971894.769651:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.769662:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.769683:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.769691:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016fc4ef6/0xbd3388eaa6f4a8e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971894.769720:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971894.769722:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790971894.769725:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971894.778866:0:15671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14444:x1877969766286208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13118us (13225us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790971894.778881:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790971894.779283:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495666680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14444:1877969766286208:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790971894.779300:0:14444:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00080000:0.0:1790971895.236499:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1790971895.236541:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790971895.653390:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971896.676760:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971896.676903:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766286336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971896.676972:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971896.677091:0:15107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286336 00000100:00100000:2.0:1790971896.677099:0:15107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286336 00000100:00100000:2.0:1790971896.677176:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790971896.677186:0:15107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766286336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971896.677217:0:15107:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971896.677278:0:15107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766286336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971896.677285:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790971896.677331:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766286336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790971896.677392:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790971896.686899:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790971897.096327:0:16181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790971897.703383:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971898.725783:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971899.496989:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.497165:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745322112 00000100:00100000:1.0:1790971899.497175:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745322112 00000100:00100000:1.0:1790971899.497235:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1790971899.497244:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1877969745322112:12345-192.168.203.43@tcp:250:mount.lustre.0 00010000:00080000:1.0:1790971899.497321:0:14414:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f@192.168.203.43@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1790971899.497353:0:14414:0:(genops.c:1384:class_connect()) connect: client 8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f, cookie 0xbd3388eaa6f4a8ed 00000100:00080000:1.0:1790971899.497671:0:14414:0:(import.c:65:import_set_state_nolock()) ffff8cd385b41800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790971899.497735:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+5:2353:x1877969745322112:12345-192.168.203.43@tcp:250:mount.lustre.0 Request processed in 490us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.497742:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1790971899.501579:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.501674:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745322240 00000100:00100000:0.0:1790971899.501684:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745322240 00000100:00100000:0.0:1790971899.501771:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:0.0:1790971899.501782:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+5:13749:x1877969745322240:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790971899.501798:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971899.501816:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd3882a7800/0xbd3388eaa6f4a8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a6c2 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971899.501844:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd3882a7800/0xbd3388eaa6f4a8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6c2 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971899.501855:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd3882a7800/0xbd3388eaa6f4a8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6c2 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971899.501864:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7800, rc 0) 00000100:00100000:0.0:1790971899.501925:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+6:13749:x1877969745322240:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 145us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.501931:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:2.0:1790971899.508673:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.508761:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745322368 00000100:00100000:0.0:1790971899.508771:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745322368 00000100:00100000:0.0:1790971899.508827:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:0.0:1790971899.508837:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+6:13749:x1877969745322368:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790971899.509273:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+6:13749:x1877969745322368:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 435us (607us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790971899.509293:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:2.0:1790971899.524857:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.528681:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745322496 00000100:00100000:0.0:1790971899.528695:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745322496 00000100:00100000:1.0:1790971899.532733:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:1.0:1790971899.532747:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+6:13749:x1877969745322496:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790971899.532766:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971899.532785:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43a00/0xbd3388eaa6f4a8fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a6c9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971899.532817:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43a00/0xbd3388eaa6f4a8fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6c9 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971899.532849:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43a00/0xbd3388eaa6f4a8fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6c9 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971899.532858:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43a00, rc 0) 00000100:00100000:1.0:1790971899.532928:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+7:13749:x1877969745322496:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 184us (8081us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.532935:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1790971899.540372:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.540578:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745322624 00000100:00100000:1.0:1790971899.540589:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745322624 00000100:00100000:1.0:1790971899.540635:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:1.0:1790971899.540644:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+7:13749:x1877969745322624:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790971899.541377:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13749:x1877969745322624:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 730us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.541386:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:2.0:1790971899.544804:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.544900:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745322752 00000100:00100000:1.0:1790971899.544909:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745322752 00000100:00100000:1.0:1790971899.544966:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:1.0:1790971899.544976:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13749:x1877969745322752:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790971899.545439:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13749:x1877969745322752:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 462us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.545449:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:2.0:1790971899.550569:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.551086:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745322880 00000100:00100000:1.0:1790971899.551097:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745322880 00000100:00100000:1.0:1790971899.551141:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:1.0:1790971899.551151:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13767:x1877969745322880:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971899.551821:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13767:x1877969745322880:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 668us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.551829:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:2.0:1790971899.598596:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.598927:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323008 00000100:00100000:1.0:1790971899.598941:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323008 00000100:00100000:1.0:1790971899.599060:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:1.0:1790971899.599072:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4833a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13767:x1877969745323008:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971899.599459:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4833a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13767:x1877969745323008:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 387us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.599497:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:2.0:1790971899.609137:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.609529:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323136 00000100:00100000:1.0:1790971899.609544:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323136 00000100:00100000:1.0:1790971899.609615:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1790971899.609627:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+8:13749:x1877969745323136:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790971899.609652:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971899.609679:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4a902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a6f3 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971899.609715:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4a902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6f3 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971899.609739:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd42c00/0xbd3388eaa6f4a902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6f3 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971899.609749:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42c00, rc 0) 00000100:00100000:1.0:1790971899.609819:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+9:13749:x1877969745323136:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 194us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.609846:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:2.0:1790971899.628348:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.628513:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323264 00000100:00100000:1.0:1790971899.628528:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323264 00000100:00100000:1.0:1790971899.628601:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:1.0:1790971899.628614:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+9:13749:x1877969745323264:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790971899.628652:0:14413:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790971899.628683:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790971899.628689:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790971899.628692:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790971899.628695:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1790971899.630897:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+9:13749:x1877969745323264:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 2268us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.630916:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:2.0:1790971899.646248:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.648940:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323392 00000100:00100000:0.0:1790971899.648961:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323392 00000100:00100000:0.0:1790971899.649195:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:0.0:1790971899.649208:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+9:13749:x1877969745323392:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790971899.649240:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971899.649266:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a6fa expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971899.649305:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971899.649319:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971899.649330:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7c00, rc 0) 00000100:00100000:0.0:1790971899.649417:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13749:x1877969745323392:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 211us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.649425:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:2.0:1790971899.653729:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.653860:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323520 00000100:00100000:1.0:1790971899.653874:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323520 00000100:00100000:1.0:1790971899.653953:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:1.0:1790971899.653964:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13749:x1877969745323520:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790971899.654365:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13749:x1877969745323520:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 401us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.654374:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:2.0:1790971899.660789:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.661099:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323648 00000100:00100000:1.0:1790971899.661113:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323648 00000100:00100000:1.0:1790971899.661186:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:1.0:1790971899.661196:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13749:x1877969745323648:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790971899.661756:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13749:x1877969745323648:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 557us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.661773:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:2.0:1790971899.669432:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971899.669625:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323776 00000100:00100000:3.0:1790971899.669637:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323776 00000100:00100000:3.0:1790971899.669691:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:3.0:1790971899.669701:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13771:x1877969745323776:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790971899.670011:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13771:x1877969745323776:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 310us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971899.670019:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:2.0:1790971899.686000:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.692648:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745323904 00000100:00100000:0.0:1790971899.692731:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745323904 00000100:00100000:1.0:1790971899.693059:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:1.0:1790971899.693070:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13771:x1877969745323904:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971899.694860:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13771:x1877969745323904:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 1782us (8858us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.694875:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:2.0:1790971899.711628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.711728:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324032 00000100:00100000:0.0:1790971899.711746:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324032 00000100:00100000:0.0:1790971899.711802:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1790971899.711810:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1877969745324032:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790971899.711839:0:14420:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e0176fed-bedb-4452-b9cc-4cbf4c411ab7@192.168.203.43@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1790971899.711897:0:14420:0:(genops.c:1384:class_connect()) connect: client e0176fed-bedb-4452-b9cc-4cbf4c411ab7, cookie 0xbd3388eaa6f4a910 00000004:00100000:0.0:1790971899.711928:0:14420:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790971899.711935:0:14420:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1790971899.754760:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766286464:0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.754838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971899.754887:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766286976:0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.755357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971899.755391:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790971899.755398:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766286592:0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.755427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971899.755446:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766287104:0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.755491:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971899.755519:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766286720:0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.755543:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971899.755560:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdda0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766287232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971899.755581:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971899.755597:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790971899.755602:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766286848:0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.755620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971899.755642:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286464 00000100:00100000:0.0:1790971899.755649:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286464 00000100:00100000:0.0:1790971899.755688:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790971899.755697:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766286464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.755746:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766286464:12345-0@lo:400:kworker.0 Request processed in 49us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.755766:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790971899.755800:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286592 00000100:00100000:0.0:1790971899.755804:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286592 00000100:00100000:0.0:1790971899.755835:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286720 00000100:00100000:0.0:1790971899.755838:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286720 00000100:00100000:0.0:1790971899.755857:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790971899.755863:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766286592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971899.755896:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766286592:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.755902:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790971899.757395:0:14421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790971899.757410:0:14421:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790971899.758697:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286976 00000100:00100000:1.0:1790971899.758709:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286976 00000100:00100000:1.0:1790971899.758755:0:14421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790971899.758761:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766287104 00000100:00100000:1.0:1790971899.758764:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766287104 00000100:00100000:1.0:1790971899.758778:0:14421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790971899.758783:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766286848 00000100:00100000:1.0:1790971899.758785:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766286848 00000100:00100000:1.0:1790971899.758795:0:14421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790971899.758804:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790971899.758813:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766286976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971899.758897:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766286976:12345-0@lo:400:kworker.0 Request processed in 85us (3540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.758904:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790971899.758920:0:14421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790971899.758927:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790971899.758933:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766287104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971899.758968:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766287104:12345-0@lo:400:kworker.0 Request processed in 35us (3497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.758974:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790971899.758994:0:14421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790971899.759000:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790971899.759006:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766286848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971899.759043:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766286848:12345-0@lo:400:kworker.0 Request processed in 37us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.759048:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790971899.759192:0:15107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766287232 00000100:00100000:1.0:1790971899.759197:0:15107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766287232 00000100:00100000:1.0:1790971899.759237:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790971899.759246:0:15107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766287232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971899.759272:0:15107:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1790971899.759288:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971899.759310:0:15107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1877969766287232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (3726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.759316:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790971899.760896:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790971899.760926:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766286720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971899.760997:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766286720:12345-0@lo:400:kworker.0 Request processed in 92us (5453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.761003:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790971899.761163:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495665180 x1877969766286848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971899.761454:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766286848:0@lo:400:kworker.0 00000100:00100000:1.0:1790971899.761496:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790971899.761513:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766286720:0@lo:400:kworker.0 00000100:00100000:1.0:1790971899.761531:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdda0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766287232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971899.761574:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766286592:0@lo:400:kworker.0 00010000:00080000:1.0:1790971899.761590:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495665f80 x1877969766287104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971899.761598:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766287104:0@lo:400:kworker.0 00000100:00100000:1.0:1790971899.761607:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766286464:0@lo:400:kworker.0 00010000:00080000:1.0:1790971899.761621:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cd495664700 x1877969766286976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790971915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790971899.761628:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766286976:0@lo:400:kworker.0 00000100:00080000:2.0:1790971899.764250:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790971899.764259:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790971899.764262:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790971899.770678:0:14420:0:(import.c:65:import_set_state_nolock()) ffff8cd385b22000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971899.771061:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2353:x1877969745324032:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 59248us (59441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.771072:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:2.0:1790971899.793842:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971899.793883:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971899.794002:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324288 00000100:00100000:1.0:1790971899.794014:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324288 00000100:00100000:1.0:1790971899.794075:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324160 00000100:00100000:1.0:1790971899.794078:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324160 00000100:00100000:1.0:1790971899.794108:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1790971899.794117:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:13749:x1877969745324288:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790971899.794165:0:14421:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790971899.794358:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1790971899.794369:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:0:x1877969745324160:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790971899.794383:0:16296:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1790971899.797939:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790971899.798298:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:13749:x1877969745324288:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 4173us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971899.798313:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1790971899.798432:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:0:x1877969745324160:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 4064us (4546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971899.798440:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1790971899.805319:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.805412:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324416 00000100:00100000:0.0:1790971899.805422:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324416 00000100:00100000:0.0:1790971899.805507:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1790971899.805517:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:13749:x1877969745324416:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790971899.805596:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:13749:x1877969745324416:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.805605:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1790971899.809406:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971899.809443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971899.809505:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971899.809578:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324544 00000100:00100000:0.0:1790971899.809588:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324544 00000100:00100000:0.0:1790971899.809627:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324672 00000100:00100000:0.0:1790971899.809629:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324672 00000100:00100000:0.0:1790971899.809648:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1790971899.809670:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877969745324544:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790971899.809700:0:15105:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e0176fed-bedb-4452-b9cc-4cbf4c411ab7@192.168.203.43@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1790971899.809729:0:15105:0:(genops.c:1384:class_connect()) connect: client e0176fed-bedb-4452-b9cc-4cbf4c411ab7, cookie 0xbd3388eaa6f4a917 00002000:00100000:0.0:1790971899.809741:0:15105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e0176fed-bedb-4452-b9cc-4cbf4c411ab7/ffff8cd385b24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790971899.809761:0:15105:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790971899.810084:0:15105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790971899.810111:0:15105:0:(import.c:65:import_set_state_nolock()) ffff8cd385b20800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971899.810172:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2353:x1877969745324544:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 502us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.810178:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1790971899.810194:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1790971899.810198:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877969745324672:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790971899.810220:0:15105:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e0176fed-bedb-4452-b9cc-4cbf4c411ab7@192.168.203.43@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1790971899.810245:0:15105:0:(genops.c:1384:class_connect()) connect: client e0176fed-bedb-4452-b9cc-4cbf4c411ab7, cookie 0xbd3388eaa6f4a91e 00002000:00100000:0.0:1790971899.810251:0:15105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e0176fed-bedb-4452-b9cc-4cbf4c411ab7/ffff8cd385b25000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790971899.810257:0:15105:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790971899.810509:0:15105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790971899.810523:0:15105:0:(import.c:65:import_set_state_nolock()) ffff8cd385b27000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790971899.810549:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2353:x1877969745324672:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 349us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971899.810556:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:3.0:1790971899.811406:0:14422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324800 00000100:00100000:3.0:1790971899.811415:0:14422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324800 00000100:00100000:3.0:1790971899.811460:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1790971899.811490:0:14422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:13749:x1877969745324800:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00080000:3.0:1790971899.814296:0:14422:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2741us 00000004:00200000:3.0:1790971899.833129:0:14422:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790971899.833246:0:14422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:13749:x1877969745324800:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 21773us (23734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971899.833258:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1790971900.179402:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971900.181651:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745324928 00000100:00100000:1.0:1790971900.181665:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745324928 00000100:00100000:1.0:1790971900.181735:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1790971900.181744:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:13792:x1877969745324928:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:1.0:1790971900.181763:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971900.181964:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43800/0xbd3388eaa6f4a925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a724 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971900.182040:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4a92c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971900.182054:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4a92c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971900.182068:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4a92c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971900.182103:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790971900.182107:0:14419:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971900.182144:0:14419:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4a92c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971900.182168:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43800/0xbd3388eaa6f4a925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a724 expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971900.182199:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4a92c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a724 expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971900.182208:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:1.0:1790971900.182211:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971900.182214:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42200, rc 0) 00000100:00100000:1.0:1790971900.182392:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:13792:x1877969745324928:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 648us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971900.182400:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000001:00100000:1.0:1790971900.371548:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e0176fed-bedb-4452-b9cc-4cbf4c411ab7 00010000:00010000:2.0:1790971900.772940:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790971900.801918:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0176fed-bedb-4452-b9cc-4cbf4c411ab7 00010000:00010000:3.0:1790971901.796634:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971901.796848:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971901.796871:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766287360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971901.796942:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971901.797101:0:15107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766287360 00000100:00100000:3.0:1790971901.797110:0:15107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766287360 00000100:00100000:3.0:1790971901.797180:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790971901.797191:0:15107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766287360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790971901.797244:0:15107:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790971901.797292:0:15107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766287360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971901.797299:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790971901.797690:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971901.797838:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766287360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790971902.223683:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.223761:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325056 00000100:00100000:2.0:1790971902.223771:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325056 00000100:00100000:2.0:1790971902.223844:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1790971902.223853:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:13844:x1877969745325056:12345-192.168.203.43@tcp:41:lfs.0 00000004:00000024:2.0:1790971902.223895:0:14420:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790971902.223994:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:13844:x1877969745325056:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971902.224001:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00080000:0.0:1790971902.224116:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971902.229436:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971902.230300:0:15107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325184 00000100:00100000:3.0:1790971902.230312:0:15107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325184 00000100:00100000:3.0:1790971902.230393:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1790971902.230403:0:15107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:13844:x1877969745325184:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:3.0:1790971902.230430:0:15107:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790971902.230553:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790971902.230719:0:15107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:13844:x1877969745325184:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 317us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971902.230727:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1790971902.240656:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.240806:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325312 00000100:00100000:1.0:1790971902.240816:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325312 00000100:00100000:1.0:1790971902.240880:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1790971902.240890:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:13844:x1877969745325312:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:1.0:1790971902.240929:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971902.241026:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:13844:x1877969745325312:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.241034:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00080000:0.0:1790971902.241873:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971902.489173:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.490230:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325440 00000100:00100000:1.0:1790971902.490242:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325440 00000100:00100000:1.0:1790971902.490356:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:1.0:1790971902.490367:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+10:13872:x1877969745325440:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790971902.490384:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971902.490403:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd43800/0xbd3388eaa6f4a933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a72b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971902.490432:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd43800/0xbd3388eaa6f4a933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a72b expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971902.490445:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd43800/0xbd3388eaa6f4a933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a72b expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971902.490455:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43800, rc 0) 00000100:00100000:1.0:1790971902.490559:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13872:x1877969745325440:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 193us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.490566:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:2.0:1790971902.504313:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.504573:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325568 00000100:00100000:1.0:1790971902.504584:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325568 00000100:00100000:1.0:1790971902.504639:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:1.0:1790971902.504648:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13872:x1877969745325568:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790971902.504939:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13872:x1877969745325568:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 291us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.504948:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:3.0:1790971902.508320:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.508582:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325696 00000100:00100000:1.0:1790971902.508593:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325696 00000100:00100000:1.0:1790971902.508653:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:1.0:1790971902.508663:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13872:x1877969745325696:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790971902.509464:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13872:x1877969745325696:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 799us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.509506:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:2.0:1790971902.548413:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971902.548508:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325824 00000100:00100000:0.0:1790971902.548519:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325824 00000100:00100000:0.0:1790971902.548575:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:0.0:1790971902.548585:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13883:x1877969745325824:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790971902.548860:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13883:x1877969745325824:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 275us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971902.548868:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:2.0:1790971902.566462:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.566581:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745325952 00000100:00100000:1.0:1790971902.566593:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745325952 00000100:00100000:1.0:1790971902.566651:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:1.0:1790971902.566662:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13883:x1877969745325952:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790971902.566942:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49561bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13883:x1877969745325952:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 281us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.566951:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:0.0:1790971902.581646:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.581840:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326080 00000100:00100000:1.0:1790971902.581863:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326080 00000100:00100000:1.0:1790971902.581921:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:1.0:1790971902.581931:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13872:x1877969745326080:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790971902.581950:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971902.581968:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4afd42e00/0xbd3388eaa6f4a93a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a755 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971902.581996:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4afd42e00/0xbd3388eaa6f4a93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a755 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971902.582008:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4afd42e00/0xbd3388eaa6f4a93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a755 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971902.582017:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42e00, rc 0) 00000100:00100000:1.0:1790971902.582076:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13872:x1877969745326080:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 146us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.582084:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:2.0:1790971902.596009:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971902.596421:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326208 00000100:00100000:0.0:1790971902.596431:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326208 00000100:00100000:0.0:1790971902.596574:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:0.0:1790971902.596586:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13872:x1877969745326208:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790971902.596615:0:14414:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790971902.596637:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790971902.596640:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790971902.596644:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790971902.596647:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790971902.599108:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13872:x1877969745326208:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 2515us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971902.599122:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:3.0:1790971902.606721:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.611403:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326336 00000100:00100000:2.0:1790971902.611419:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326336 00000100:00100000:2.0:1790971902.611510:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:2.0:1790971902.611521:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13872:x1877969745326336:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790971902.611541:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971902.611559:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a75c expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.611589:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.611601:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.611609:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e000, rc 0) 00000100:00100000:2.0:1790971902.611683:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13872:x1877969745326336:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 164us (4971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971902.611691:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:2.0:1790971902.625463:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971902.625653:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326464 00000100:00100000:0.0:1790971902.625663:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326464 00000100:00100000:0.0:1790971902.625717:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:0.0:1790971902.625727:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13872:x1877969745326464:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790971902.626045:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13872:x1877969745326464:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 318us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971902.626064:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:3.0:1790971902.629388:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.629495:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326592 00000100:00100000:1.0:1790971902.629505:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326592 00000100:00100000:1.0:1790971902.629562:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:1.0:1790971902.629570:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13872:x1877969745326592:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790971902.629794:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13872:x1877969745326592:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 224us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.629803:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:3.0:1790971902.634174:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.634319:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326720 00000100:00100000:2.0:1790971902.634338:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326720 00000100:00100000:2.0:1790971902.634422:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:2.0:1790971902.634433:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13888:x1877969745326720:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790971902.634922:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13888:x1877969745326720:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 488us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971902.634932:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:2.0:1790971902.648833:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971902.648946:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326848 00000100:00100000:0.0:1790971902.648957:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326848 00000100:00100000:0.0:1790971902.649020:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:0.0:1790971902.649031:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd49fe3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13888:x1877969745326848:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790971902.649641:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd49fe3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13888:x1877969745326848:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 609us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971902.649650:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:3.0:1790971902.676271:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.676400:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745326976 00000100:00100000:1.0:1790971902.676414:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745326976 00000100:00100000:1.0:1790971902.676503:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971902.676510:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1877969745326976:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790971902.676551:0:16296:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 15990494-edec-4067-b056-823ad473edfe@192.168.203.43@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:1.0:1790971902.676585:0:16296:0:(genops.c:1384:class_connect()) connect: client 15990494-edec-4067-b056-823ad473edfe, cookie 0xbd3388eaa6f4a948 00000004:00100000:1.0:1790971902.676613:0:16296:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790971902.676727:0:16296:0:(import.c:65:import_set_state_nolock()) ffff8cd385b43800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790971902.676801:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15990494-edec-4067-b056-823ad473edfe+6:2353:x1877969745326976:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 288us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.676809:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1790971902.685941:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.686512:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745327232 00000100:00100000:2.0:1790971902.686526:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745327232 00000100:00100000:2.0:1790971902.686639:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:2.0:1790971902.686650:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:13872:x1877969745327232:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790971902.686694:0:14420:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790971902.686789:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:13872:x1877969745327232:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 141us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971902.686798:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1790971902.687182:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971902.687229:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745327104 00000100:00100000:0.0:1790971902.687235:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745327104 00000100:00100000:0.0:1790971902.687271:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1790971902.687280:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15990494-edec-4067-b056-823ad473edfe+6:0:x1877969745327104:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790971902.687298:0:16296:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790971902.687336:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15990494-edec-4067-b056-823ad473edfe+6:0:x1877969745327104:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971902.687343:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00080000:3.0:1790971902.687798:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971902.701677:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.701810:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745327360 00000100:00100000:2.0:1790971902.701823:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745327360 00000100:00100000:2.0:1790971902.701934:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1790971902.701947:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:13872:x1877969745327360:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790971902.702280:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:13872:x1877969745327360:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 335us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971902.702290:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1790971902.707375:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.707497:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971902.707769:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745327488 00000100:00100000:1.0:1790971902.707783:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745327488 00000100:00100000:1.0:1790971902.707847:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971902.707857:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1877969745327488:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790971902.707898:0:15105:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 15990494-edec-4067-b056-823ad473edfe@192.168.203.43@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:1.0:1790971902.707942:0:15105:0:(genops.c:1384:class_connect()) connect: client 15990494-edec-4067-b056-823ad473edfe, cookie 0xbd3388eaa6f4a94f 00002000:00100000:1.0:1790971902.707957:0:15105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 15990494-edec-4067-b056-823ad473edfe/ffff8cd385b44000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790971902.707972:0:15105:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790971902.708322:0:15105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790971902.708363:0:15105:0:(import.c:65:import_set_state_nolock()) ffff8cd494dd1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790971902.708454:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15990494-edec-4067-b056-823ad473edfe+6:2353:x1877969745327488:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 597us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.708463:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1790971902.709441:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.709538:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745327616 00000100:00100000:2.0:1790971902.709548:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745327616 00000100:00100000:2.0:1790971902.709586:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:2.0:1790971902.709594:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1877969745327616:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790971902.709628:0:15104:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 15990494-edec-4067-b056-823ad473edfe@192.168.203.43@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:2.0:1790971902.709661:0:15104:0:(genops.c:1384:class_connect()) connect: client 15990494-edec-4067-b056-823ad473edfe, cookie 0xbd3388eaa6f4a956 00002000:00100000:2.0:1790971902.709674:0:15104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 15990494-edec-4067-b056-823ad473edfe/ffff8cd386c4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790971902.709704:0:15104:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790971902.709967:0:15104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790971902.710001:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8cd386c4f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790971902.710685:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15990494-edec-4067-b056-823ad473edfe+6:2353:x1877969745327616:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 1084us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971902.710696:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1790971902.712358:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745327744 00000100:00100000:1.0:1790971902.712380:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745327744 00000100:00100000:1.0:1790971902.712573:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1790971902.712586:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15990494-edec-4067-b056-823ad473edfe+6:13872:x1877969745327744:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790971902.712717:0:14423:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790971902.712839:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15990494-edec-4067-b056-823ad473edfe+6:13872:x1877969745327744:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 255us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971902.712847:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00010000:00010000:2.0:1790971902.822345:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971902.920814:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971902.920924:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745327872 00000100:00100000:2.0:1790971902.920937:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745327872 00000100:00100000:2.0:1790971902.921015:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1790971902.921025:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+6:13909:x1877969745327872:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:2.0:1790971902.921051:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971902.921083:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a95d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a786 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.921177:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.921193:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.921220:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971902.921267:0:14421:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790971902.921280:0:14421:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971902.921308:0:14421:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.921362:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a95d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.921383:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971902.921392:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:2.0:1790971902.921395:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790971902.921399:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fa00, rc 0) 00000100:00100000:2.0:1790971902.921544:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+7:13909:x1877969745327872:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 520us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971902.921553:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000040:00080000:0.0:1790971903.141685:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790971903.845240:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790971904.868619:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971904.869094:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790971904.869113:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766287488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971904.869216:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971904.871227:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766287488 00000100:00100000:1.0:1790971904.871241:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766287488 00000100:00100000:1.0:1790971904.871301:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790971904.871311:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766287488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971904.871346:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971904.871423:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766287488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971904.871429:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1790971904.871456:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971904.871521:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766287488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971904.871769:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766287744:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.871806:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971904.871831:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971904.871837:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766287872:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.871863:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971904.871893:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766287744 00000100:00100000:2.0:1790971904.871897:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766287744 00000100:00100000:2.0:1790971904.871933:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790971904.871940:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766287744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.871975:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766287744:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971904.871994:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790971904.872010:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971904.872019:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766288000:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872054:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971904.872073:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790971904.872078:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766287616:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872104:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971904.872128:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766288128:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872149:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971904.872176:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766287872 00000100:00100000:2.0:1790971904.872179:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766287872 00000100:00100000:2.0:1790971904.872219:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766288000 00000100:00100000:2.0:1790971904.872222:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766288000 00000100:00100000:2.0:1790971904.872238:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766288128 00000100:00100000:2.0:1790971904.872241:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766288128 00000100:00100000:2.0:1790971904.872253:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790971904.872260:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766287872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872291:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1877969766287872:12345-0@lo:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971904.872296:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790971904.872309:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790971904.872315:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766288000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872344:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766288000:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971904.872349:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790971904.872360:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790971904.872365:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766288128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872391:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877969766288128:12345-0@lo:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971904.872406:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790971904.872424:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766287616 00000100:00100000:2.0:1790971904.872427:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766287616 00000100:00100000:2.0:1790971904.872450:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790971904.872456:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766287616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872510:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766287616:12345-0@lo:400:kworker.0 Request processed in 54us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971904.872516:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1790971904.872544:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971904.872564:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1877969766287872:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872574:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766287744:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872601:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766287616:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872610:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1877969766288128:0@lo:400:kworker.0 00000100:00100000:2.0:1790971904.872619:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766288000:0@lo:400:kworker.0 00000001:00100000:0.0:1790971904.940505:0:5861:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e0176fed-bedb-4452-b9cc-4cbf4c411ab7 00000001:00100000:0.0:1790971904.940524:0:5861:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15990494-edec-4067-b056-823ad473edfe 00000001:00100000:1.0:1790971905.444708:0:7646:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15990494-edec-4067-b056-823ad473edfe 00010000:00010000:3.0:1790971905.896242:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790971906.013768:0:16387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1790971906.043818:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15990494-edec-4067-b056-823ad473edfe 00000100:00100000:1.0:1790971906.917902:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766288256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790971906.918005:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971906.921617:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766288256 00000100:00100000:0.0:1790971906.921638:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766288256 00000100:00100000:0.0:1790971906.921731:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971906.921744:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766288256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790971906.921813:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790971906.921926:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766288256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971906.921935:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790971906.922016:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766288256:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790971906.928846:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790971906.936020:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790971907.941090:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971908.006522:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971908.006568:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971908.006588:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971908.006616:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971908.006637:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971908.006653:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971908.006673:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971908.006698:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328000 00000100:00100000:0.0:1790971908.006708:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328000 00000100:00100000:0.0:1790971908.006755:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:0.0:1790971908.006765:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:2354:x1877969745328000:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971908.006835:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:2354:x1877969745328000:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971908.006844:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:2.0:1790971908.007565:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328128 00000100:00100000:2.0:1790971908.007572:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328128 00000100:00100000:2.0:1790971908.007617:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328512 00000100:00100000:2.0:1790971908.007621:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328512 00000100:00100000:2.0:1790971908.007649:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971908.007656:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2354:x1877969745328128:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971908.007703:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2354:x1877969745328128:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 47us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971908.007720:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971908.007744:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1790971908.007751:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:2354:x1877969745328512:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971908.007778:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:2354:x1877969745328512:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971908.007784:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1790971908.007805:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328384 00000100:00100000:2.0:1790971908.007808:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328384 00000100:00100000:2.0:1790971908.007831:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328640 00000100:00100000:2.0:1790971908.007834:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328640 00000100:00100000:2.0:1790971908.007844:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328256 00000100:00100000:2.0:1790971908.007846:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328256 00000100:00100000:2.0:1790971908.007857:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328768 00000100:00100000:2.0:1790971908.007860:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328768 00000100:00100000:2.0:1790971908.007872:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1790971908.007878:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2354:x1877969745328384:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971908.007903:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2354:x1877969745328384:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971908.007908:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1790971908.007920:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1790971908.007926:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745328640:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971908.008125:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745328640:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 198us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971908.008132:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1790971908.008234:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1790971908.008243:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2354:x1877969745328256:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971908.008283:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2354:x1877969745328256:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971908.008289:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1790971908.008303:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1790971908.008619:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745328768:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1790971908.008647:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745328768:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 32us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971908.008653:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00080000:0.0:1790971908.008950:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790971908.008954:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971908.008957:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790971908.975610:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790971909.823881:0:16535:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe01eae400 20000000:00000080:2.0:1790971909.824032:0:16535:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cd386a53c00 uarg=0000000000000000 20000000:01000000:2.0:1790971909.824195:0:16535:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790971909.824201:0:16535:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790971909.824206:0:16535:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790971909.825817:0:16536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1790971909.826293:0:16535:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790971909.838642:0:16535:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790971909.838804:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.838823:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.838831:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.838838:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.838848:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.838868:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.838876:0:16535:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.839032:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.839046:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 12 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.839166:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288384:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971909.839353:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.839362:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 12 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.839371:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288512:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971909.839402:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.839411:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 18 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.839419:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288640:0@lo:104: 00000100:00100000:3.0:1790971909.839455:0:16535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971909.839526:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.839534:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 18 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.839542:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288768:0@lo:104: 00000100:00100000:3.0:1790971909.839561:0:16535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971909.839581:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.839589:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 18 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.839596:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288896:0@lo:104: 00000100:00100000:3.0:1790971909.839616:0:16535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790971909.839623:0:16535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b6f21840 going to sleep for 11 seconds 00000100:00100000:2.0:1790971909.839714:0:14402:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790971909.839727:0:14402:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766288640 00000100:00100000:2.0:1790971909.839742:0:14402:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766288640 00000100:00100000:2.0:1790971909.839775:0:14402:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766288768 00000100:00100000:2.0:1790971909.839777:0:14402:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766288768 00000100:00100000:2.0:1790971909.839784:0:14402:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766288896 00000100:00100000:2.0:1790971909.839786:0:14402:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766288896 00000100:00100000:2.0:1790971909.839797:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790971909.839804:0:14402:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+5:16535:x1877969766288640:12345-0@lo:104: 00010000:00010000:2.0:1790971909.839816:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.839859:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790971909.839864:0:14402:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+5:16535:x1877969766288640:12345-0@lo:104: Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.839871:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790971909.839887:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790971909.839902:0:14402:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+4:16535:x1877969766288768:12345-0@lo:104: 00010000:00010000:2.0:1790971909.839909:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.839941:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790971909.839945:0:14402:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+4:16535:x1877969766288768:12345-0@lo:104: Request processed in 53us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.839957:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790971909.839976:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790971909.839982:0:14402:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+3:16535:x1877969766288896:12345-0@lo:104: 00010000:00010000:2.0:1790971909.839988:0:14402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840011:0:14402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790971909.840015:0:14402:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be074850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6e841c93-8375-413d-802b-5f81a8a5481c+3:16535:x1877969766288896:12345-0@lo:104: Request processed in 34us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.840020:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790971909.840051:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790971909.840066:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840073:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4be12f200 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971909.840077:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840086:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971909.840093:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971909.840099:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790971909.840131:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840138:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971909.840175:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840183:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4be12f200/0xbd3388eaa6f4a7e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a7ea expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840199:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790971909.840203:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840208:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ec00 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971909.840211:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840217:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971909.840233:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971909.840238:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790971909.840252:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840257:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971909.840271:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840278:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4a6a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a6af expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840298:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971909.840301:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840307:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d800 already unused, calling callback (ffffffffc1c89c20) 10000000:00010000:2.0:1790971909.840309:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840317:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790971909.840323:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790971909.840328:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790971909.840342:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840347:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790971909.840354:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840360:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff8cd4a002d800/0xbd3388eaa6f4a65b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd3388eaa6f4a662 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.840374:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971909.840376:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971909.840378:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971909.840399:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766289024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790971909.840437:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971909.840492:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766289152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790971909.840515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971909.840532:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790971909.840536:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766289280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790971909.840557:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790971909.841001:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971909.841022:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289024 00000100:00100000:1.0:1790971909.841029:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289024 00010000:00010000:1.0:1790971909.841055:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 19 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971909.841071:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289152 00000100:00100000:1.0:1790971909.841082:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289152 00010000:00010000:1.0:1790971909.841094:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 20 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971909.841114:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289280 00000100:00100000:1.0:1790971909.841117:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289280 00010000:00010000:1.0:1790971909.841127:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 21 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971909.841138:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790971909.841144:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+21:3305:x1877969766289024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971909.841166:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971909.841171:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 21 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971909.841181:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 21 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971909.841198:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971909.841253:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+21:3305:x1877969766289024:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971909.841260:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790971909.841277:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790971909.841283:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+20:3302:x1877969766289152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971909.841291:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971909.841295:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 20 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971909.841302:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 20 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971909.841323:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971909.841356:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+20:3302:x1877969766289152:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971909.841363:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790971909.841375:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790971909.841381:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487871c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766289280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790971909.841389:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971909.841394:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 19 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971909.841401:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 19 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971909.841410:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971909.841431:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487871c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766289280:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971909.841437:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790971909.841523:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766289280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790971909.841532:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766289152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790971909.841802:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6e841c93-8375-413d-802b-5f81a8a5481c:3305:1877969766289024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790971909.842743:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a7ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4a7e3 expref: 18 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.842760:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288640:0@lo:104: 00010000:00010000:3.0:1790971909.842773:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a6af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4a6a8 expref: 17 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.842782:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495ace300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288768:0@lo:104: 00010000:00010000:3.0:1790971909.842791:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd3388eaa6f4a65b expref: 16 pid: 14414 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971909.842798:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495aced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288896:0@lo:104: 00000100:00100000:0.0:1790971909.857938:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971909.857980:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288384:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971909.857990:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971909.858014:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1877969766288512:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971909.858047:0:16535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971909.858181:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745328896 00000100:00100000:2.0:1790971909.858189:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745328896 00010000:00010000:2.0:1790971909.858224:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 13 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971909.858261:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329024 00000100:00100000:2.0:1790971909.858265:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329024 00010000:00010000:2.0:1790971909.858276:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 14 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971909.858292:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1790971909.858300:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+14:2357:x1877969745328896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971909.858316:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971909.858321:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 14 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858332:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 14 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858350:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a941 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a75c expref: 14 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858379:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971909.858441:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:2357:x1877969745328896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 141us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.858448:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1790971909.858467:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1790971909.858515:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:2357:x1877969745329024:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971909.858522:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971909.858526:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 12 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858534:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 12 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858544:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd3882a7c00/0xbd3388eaa6f4a909 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a6fa expref: 12 pid: 14411 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858554:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858561:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858575:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858581:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858599:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858606:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858612:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971909.858616:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858625:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858635:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971909.858644:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971909.858664:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:2357:x1877969745329024:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 155us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.858670:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00010000:00010000:3.0:1790971909.859338:0:16535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.859351:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971909.859359:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cd4a002c200/0xbd3388eaa6f4a96b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971909.994463:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766289408:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.995385:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971909.995436:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766289920:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.995464:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971909.995506:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790971909.995513:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766289536:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.995535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971909.995599:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766289664:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.995623:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971909.995639:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790971909.995644:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766289792:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.995674:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790971909.995697:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790971909.995710:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289408 00000100:00100000:2.0:1790971909.995718:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289408 00000100:00100000:2.0:1790971909.995766:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289536 00000100:00100000:2.0:1790971909.995770:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289536 00000100:00100000:2.0:1790971909.995793:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790971909.995801:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766289408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.995853:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766289408:12345-0@lo:400:kworker.0 Request processed in 52us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.995860:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790971909.995876:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971909.995882:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766289536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.995912:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766289536:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.995919:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971909.995937:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289920 00000100:00100000:2.0:1790971909.995941:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289920 00000100:00080000:0.0:1790971909.995950:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790971909.995957:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790971909.995959:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971909.995965:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289664 00000100:00100000:2.0:1790971909.995969:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289664 00000100:00100000:2.0:1790971909.995979:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766289792 00000100:00100000:2.0:1790971909.995981:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766289792 00000100:00100000:2.0:1790971909.996002:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790971909.996007:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.996046:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766289920:12345-0@lo:400:kworker.0 Request processed in 39us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.996052:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790971909.996069:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790971909.996075:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766289664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.996107:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766289664:12345-0@lo:400:kworker.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.996113:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790971909.996124:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790971909.996129:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.996167:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766289792:12345-0@lo:400:kworker.0 Request processed in 37us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.996172:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790971909.996202:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971909.996228:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766289536:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.996238:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766289408:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.996245:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766289920:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.996274:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766289792:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.996281:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766289664:0@lo:400:kworker.0 00000100:00100000:2.0:1790971909.997510:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790971909.997745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971909.997789:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290048 00000100:00100000:2.0:1790971909.997795:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290048 00000100:00100000:2.0:1790971909.997836:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971909.997842:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766290048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790971909.997871:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971909.997913:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971909.997919:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790971909.998143:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766290048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790971911.013801:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971911.531759:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971911.531842:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329152 00000100:00100000:2.0:1790971911.531853:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329152 00000100:00100000:2.0:1790971911.531913:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:2.0:1790971911.531923:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+11:13763:x1877969745329152:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971911.531940:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971911.531959:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a78d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.531987:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a78d expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.531999:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5f800/0xbd3388eaa6f4a972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a78d expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.532008:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f800, rc 0) 00000100:00100000:2.0:1790971911.532075:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13763:x1877969745329152:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 153us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971911.532092:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:2.0:1790971911.545406:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971911.545548:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329280 00000100:00100000:0.0:1790971911.545557:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329280 00000100:00100000:0.0:1790971911.545727:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:0.0:1790971911.545736:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13763:x1877969745329280:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.546100:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13763:x1877969745329280:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 363us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.546108:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:1.0:1790971911.550433:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971911.550596:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329408 00000100:00100000:0.0:1790971911.550605:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329408 00000100:00100000:0.0:1790971911.550655:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:0.0:1790971911.550664:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13763:x1877969745329408:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.550869:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13763:x1877969745329408:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 205us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.550878:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:2.0:1790971911.564206:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971911.564283:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329536 00000100:00100000:3.0:1790971911.564293:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329536 00000100:00100000:3.0:1790971911.564350:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:3.0:1790971911.564360:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+12:13763:x1877969745329536:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790971911.564448:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971911.564487:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a979 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797c86479917a794 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971911.564518:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a794 expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971911.564530:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4a002c000/0xbd3388eaa6f4a979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a794 expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971911.564551:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002c000, rc 0) 00000100:00100000:3.0:1790971911.564613:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13763:x1877969745329536:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 253us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971911.564627:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:2.0:1790971911.577761:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971911.580328:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329664 00000100:00100000:0.0:1790971911.580343:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329664 00000100:00100000:0.0:1790971911.580414:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:0.0:1790971911.580423:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13763:x1877969745329664:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.580789:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13763:x1877969745329664:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 365us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.580797:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:1.0:1790971911.593304:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971911.594512:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329792 00000100:00100000:3.0:1790971911.594523:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329792 00000100:00100000:3.0:1790971911.594572:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:3.0:1790971911.594583:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13763:x1877969745329792:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790971911.594800:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:13763:x1877969745329792:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 218us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971911.594809:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 111 10000000:01000000:2.0:1790971911.847050:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790971911.847058:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4aff9f000 from 10 10000000:01000000:2.0:1790971911.847064:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790971911.847119:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5e400/0xbd3388eaa6f4a980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.847133:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5e400/0xbd3388eaa6f4a980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.847155:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5e400/0xbd3388eaa6f4a980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971911.847181:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790971911.847252:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971911.847310:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a064c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971911.847742:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290176 00000100:00100000:0.0:1790971911.847749:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290176 00000100:00100000:0.0:1790971911.847797:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790971911.847806:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+16:14416:x1877969766290176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971911.847818:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971911.847831:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd3882a6a00/0xbd3388eaa6f4a987 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a980 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.847854:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd3882a6a00/0xbd3388eaa6f4a987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a980 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.847864:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd3882a6a00/0xbd3388eaa6f4a987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a980 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.847873:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a6a00, rc 0) 00000100:00100000:0.0:1790971911.847919:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+17:14416:x1877969766290176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.847925:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790971911.848039:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971911.848055:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5e400/0xbd3388eaa6f4a980 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a987 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.848064:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5e400/0xbd3388eaa6f4a980 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a987 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971911.848680:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971911.848868:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971911.848959:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a064c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790971911.852983:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290304 00000100:00100000:3.0:1790971911.852998:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290304 00000100:00100000:3.0:1790971911.853058:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790971911.853069:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:14416:x1877969766290304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790971911.853418:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:14416:x1877969766290304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (4548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971911.853426:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790971911.853783:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790971911.853841:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790971911.853895:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971911.853933:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a064c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971911.854006:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290432 00000100:00100000:0.0:1790971911.854012:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290432 00000100:00100000:0.0:1790971911.854051:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790971911.854059:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+17:14416:x1877969766290432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.854231:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+17:14416:x1877969766290432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.854247:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790971911.854266:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790971911.855285:0:16633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790971911.856327:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790971911.856354:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971911.856365:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5e400/0xbd3388eaa6f4a980 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a987 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.856378:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd4bdd5e400/0xbd3388eaa6f4a980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a987 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971911.856388:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790971911.856391:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd4be09e000 from 10 10000000:01000000:0.0:1790971911.856393:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790971911.856430:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7200/0xbd3388eaa6f4a98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.856439:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7200/0xbd3388eaa6f4a98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.856449:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7200/0xbd3388eaa6f4a98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971911.856493:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.856551:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971911.856579:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971911.856600:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290560 00000100:00100000:0.0:1790971911.856607:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290560 00000100:00100000:0.0:1790971911.856648:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790971911.856657:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+17:14416:x1877969766290560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971911.856671:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971911.856692:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd3882a6600/0xbd3388eaa6f4a995 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a98e expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.856715:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd3882a6600/0xbd3388eaa6f4a995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a98e expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.856726:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd3882a6600/0xbd3388eaa6f4a995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a98e expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.856734:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a6600, rc 0) 00000100:00100000:0.0:1790971911.856775:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+18:14416:x1877969766290560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.856783:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790971911.856830:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790971911.856845:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7200/0xbd3388eaa6f4a98e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a995 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.856854:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7200/0xbd3388eaa6f4a98e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a995 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971911.856905:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.856933:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971911.856947:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971911.856960:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290688 00000100:00100000:0.0:1790971911.856963:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290688 00000100:00100000:0.0:1790971911.856985:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790971911.856991:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:14416:x1877969766290688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.857252:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+18:14416:x1877969766290688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.857266:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790971911.857299:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.857328:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.857370:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971911.857384:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790971911.857398:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290816 00000100:00100000:0.0:1790971911.857401:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290816 00000100:00100000:0.0:1790971911.857426:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790971911.857433:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c024ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+18:14416:x1877969766290816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.857591:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c024ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+18:14416:x1877969766290816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.857599:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790971911.857647:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790971911.864878:0:16634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790971911.865357:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790971911.865383:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790971911.865395:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7200/0xbd3388eaa6f4a98e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a995 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.865407:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7200/0xbd3388eaa6f4a98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a995 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790971911.865418:0:14416:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790971911.865421:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cd485573800 from 10 10000000:01000000:0.0:1790971911.865425:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790971911.865460:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7600/0xbd3388eaa6f4a99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.865737:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7600/0xbd3388eaa6f4a99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971911.865749:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7600/0xbd3388eaa6f4a99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971911.865842:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.865912:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971911.866056:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a74d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790971911.866165:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766290944 00000100:00100000:2.0:1790971911.866173:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766290944 00000100:00100000:2.0:1790971911.866263:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790971911.866275:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd48db64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+18:14416:x1877969766290944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790971911.866290:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971911.866303:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a9a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd3388eaa6f4a99c expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.866328:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a99c expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.866340:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cd4bdd5ea00/0xbd3388eaa6f4a9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd3388eaa6f4a99c expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.866348:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5ea00, rc 0) 00000100:00100000:2.0:1790971911.866398:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd48db64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766290944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971911.866406:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790971911.867072:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387fe9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766290944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790971911.867094:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7600/0xbd3388eaa6f4a99c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a9a3 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971911.867118:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7600/0xbd3388eaa6f4a99c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd3388eaa6f4a9a3 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971911.867195:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766291072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790971911.867233:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971911.869878:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766291072 00000100:00100000:0.0:1790971911.869894:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766291072 00000100:00100000:1.0:1790971911.869923:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4b52d2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790971911.870067:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790971911.870079:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766291072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.870371:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766291072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.870380:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790971911.870441:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766291072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.870681:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd387feb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766291200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.870728:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971911.870749:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd495a749c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790971911.870762:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766291200 00000100:00100000:0.0:1790971911.870766:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766291200 00000100:00100000:0.0:1790971911.870856:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790971911.870863:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766291200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790971911.871231:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:14416:x1877969766291200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 367us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971911.871245:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790971911.871321:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd387feb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6e841c93-8375-413d-802b-5f81a8a5481c:14416:1877969766291200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790971911.873891:0:16635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790971911.874285:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790971911.874310:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790971911.874321:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7600/0xbd3388eaa6f4a99c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a9a3 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971911.874346:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff8cd3882a7600/0xbd3388eaa6f4a99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd3388eaa6f4a9a3 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971912.036760:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971912.044760:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766291328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971912.044832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971912.045655:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766291328 00000100:00100000:2.0:1790971912.045664:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766291328 00000100:00100000:2.0:1790971912.045722:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971912.045732:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766291328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971912.045771:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971912.045832:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877969766291328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971912.045839:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790971912.045893:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1877969766291328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971912.049161:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790971913.060688:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971913.126143:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.126200:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.126238:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.126287:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.126317:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971913.126342:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745330304 00000100:00100000:0.0:1790971913.126358:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745330304 00000100:00100000:3.0:1790971913.126372:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971913.126433:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745330560 00000100:00100000:0.0:1790971913.126438:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745330560 00000100:00100000:1.0:1790971913.126447:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745330176 00000100:00100000:1.0:1790971913.126454:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745330176 00000100:00100000:0.0:1790971913.126508:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1790971913.126522:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2356:x1877969745330304:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971913.126528:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1790971913.126539:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15990494-edec-4067-b056-823ad473edfe+5:2356:x1877969745330560:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971913.126655:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745330048 00000100:00100000:2.0:1790971913.126661:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745330048 00000100:00100000:2.0:1790971913.126695:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745330432 00000100:00100000:2.0:1790971913.126698:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745330432 00000100:00100000:2.0:1790971913.126719:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:2.0:1790971913.126727:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2356:x1877969745330048:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971913.126794:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2356:x1877969745330304:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 275us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971913.126802:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1790971913.126820:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1790971913.126828:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2356:x1877969745330176:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:3.0:1790971913.128269:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790971913.129862:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790971913.129873:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971913.130035:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1790971913.130056:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:2356:x1877969745330432:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971913.134768:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15990494-edec-4067-b056-823ad473edfe+5:2356:x1877969745330560:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 8219us (8517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971913.134783:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1790971913.134813:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.134860:0:15106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745330688 00000100:00100000:2.0:1790971913.134869:0:15106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745330688 00000100:00100000:2.0:1790971913.135173:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1790971913.135183:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2356:x1877969745330688:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1790971913.136346:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2356:x1877969745330176:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 9511us (10021us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971913.136357:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1790971913.138620:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+6:2356:x1877969745330432:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 8555us (12229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971913.138641:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1790971913.138728:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2356:x1877969745330688:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3535us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971913.138733:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745329920 00000100:00100000:3.0:1790971913.138747:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745329920 00000100:00100000:2.0:1790971913.138763:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00080000:2.0:1790971913.138817:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790971913.138839:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:2.0:1790971913.138844:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2356:x1877969745330048:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 12113us (12719us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971913.138857:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:2356:x1877969745329920:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971913.138864:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1790971913.140713:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:2356:x1877969745329920:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 1849us (14420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971913.140730:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:3.0:1790971913.301701:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.302006:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745330816 00000100:00100000:2.0:1790971913.302020:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745330816 00000100:00100000:2.0:1790971913.302114:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1790971913.302138:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:14420:x1877969745330816:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971913.302167:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971913.302198:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a79b expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302287:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302305:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302320:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302338:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302345:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302352:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302815:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a9bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302826:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a9bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.302834:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a9bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971913.302863:0:14421:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790971913.302945:0:14421:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971913.302996:0:14421:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a9bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303010:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303017:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303025:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303032:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971913.303038:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303046:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303061:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:2.0:1790971913.303071:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971913.303078:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303084:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4a9b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303100:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303106:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303111:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303117:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971913.303120:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303139:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303148:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cd4a656ce00) 00010000:00010000:2.0:1790971913.303150:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971913.303153:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303159:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4a9b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303202:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a79b expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303228:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e000/0xbd3388eaa6f4a9bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a79b expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.303235:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cd4a656cf00) 00010000:00010000:2.0:1790971913.303237:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790971913.303239:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e000, rc 0) 00000100:00100000:2.0:1790971913.303332:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:14420:x1877969745330816:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1207us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971913.303340:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:1.0:1790971913.313276:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.313533:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745331072 00000100:00100000:3.0:1790971913.313547:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745331072 00000100:00100000:3.0:1790971913.313761:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1790971913.313784:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:14420:x1877969745331072:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971913.313815:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971913.313848:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4a9c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7a2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.315006:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.315058:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.315074:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.321534:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.321559:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.321571:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.322356:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a9db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.322368:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a9db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.322376:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a9db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971913.322387:0:14420:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790971913.326311:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326328:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326336:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326358:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971913.326363:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326373:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326389:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cd4a656cf00) 00010000:00010000:3.0:1790971913.326392:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971913.326397:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326404:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4a9cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326421:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326427:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326433:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326439:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971913.326442:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326447:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326892:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cd483040800) 00010000:00010000:3.0:1790971913.326898:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971913.326902:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.326908:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4a9d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.331121:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4a9c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7a2 expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.331157:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d800/0xbd3388eaa6f4a9db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7a2 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.331166:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040900) 00010000:00010000:3.0:1790971913.331169:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971913.331172:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d800, rc 0) 00000100:00100000:3.0:1790971913.332324:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14420:x1877969745331072:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 18549us (19057us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790971913.332336:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1790971913.354722:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.355513:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745331200 00000100:00100000:2.0:1790971913.355524:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745331200 00000100:00100000:2.0:1790971913.355581:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1790971913.355593:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14420:x1877969745331200:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790971913.355801:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14420:x1877969745331200:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 209us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971913.355912:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000040:00080000:2.0:1790971913.388460:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790971913.409615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.409732:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745331328 00000100:00100000:1.0:1790971913.409745:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745331328 00000100:00100000:1.0:1790971913.409827:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1790971913.409841:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14426:x1877969745331328:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971913.409872:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971913.409905:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f4a9e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7a9 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.410050:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.410092:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.410107:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.411922:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.411945:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.411959:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412173:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412183:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412190:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412197:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971913.412201:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412208:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412220:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:1.0:1790971913.412229:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971913.412234:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412240:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4a9f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412253:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412259:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412265:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412270:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971913.412272:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412279:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412285:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cd496815500) 00010000:00010000:1.0:1790971913.412287:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971913.412290:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412295:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4a9f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412340:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f4a9e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7a9 expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412357:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:1.0:1790971913.412359:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971913.412363:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43400/0xbd3388eaa6f4a9e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7a9 expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.412373:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd43400, rc 0) 00000100:00100000:1.0:1790971913.412738:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14426:x1877969745331328:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2900us (3139us total) trans 0 rc 301/301 00000100:00100000:1.0:1790971913.412745:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1790971913.423778:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.424270:0:14428:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745331456 00000100:00100000:3.0:1790971913.424285:0:14428:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745331456 00000100:00100000:3.0:1790971913.424355:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1790971913.424365:0:14428:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14426:x1877969745331456:12345-192.168.203.43@tcp:700:lfs.0 00000100:00100000:3.0:1790971913.424511:0:14428:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14426:x1877969745331456:12345-192.168.203.43@tcp:700:lfs.0 Request processed in 147us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971913.424518:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1790971913.431349:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.432150:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745331712 00000100:00100000:2.0:1790971913.432173:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745331712 00000100:00100000:2.0:1790971913.432305:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971913.432318:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14426:x1877969745331712:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:2.0:1790971913.432397:0:16296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971913.432437:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4a92c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a724 expref: 9 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.432519:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:2.0:1790971913.432525:0:16296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971913.432806:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.432823:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 5 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.432833:0:16296:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.432875:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 5 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.432893:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 5 pid: 14421 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971913.432911:0:16296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16296:1877969766291456:192.168.203.43@tcp:104: 00000100:00100000:2.0:1790971913.433028:0:16296:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4a064c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790971913.439542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.439744:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745331840 00000100:00100000:1.0:1790971913.439757:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745331840 00010000:00010000:1.0:1790971913.439812:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 6 pid: 14421 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971913.439865:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1790971913.439877:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15990494-edec-4067-b056-823ad473edfe+6:2357:x1877969745331840:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971913.439896:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971913.439903:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 6 pid: 14421 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.439918:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 6 pid: 14421 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.439945:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:1.0:1790971913.439967:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.439979:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.439988:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.440012:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971913.440306:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15990494-edec-4067-b056-823ad473edfe+6:2357:x1877969745331840:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 429us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971913.440318:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00010000:00010000:2.0:1790971913.440884:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4a964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a786 expref: 5 pid: 14421 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971913.440909:0:16296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16296:1877969766291456:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971913.440940:0:16296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.440951:0:16296:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.440970:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.440997:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.441009:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.441019:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971913.445634:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790971913.445664:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.445677:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.445687:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.445694:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971913.445761:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.445771:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.445791:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd496815300) 00010000:00010000:2.0:1790971913.445795:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971913.445811:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.445819:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4a9fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790971913.445846:0:16296:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a5d7c409 reply state 000000006913f90b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971913.445856:0:16296:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971913.446047:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+10:14426:x1877969745331712:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 13726us (14707us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790971913.446057:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00010000:00010000:1.0:1790971913.455804:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.455827:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.455837:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.455844:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971913.455850:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.455859:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.455879:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cd4a656ce00) 00010000:00010000:1.0:1790971913.455882:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971913.455905:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.455912:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aa05 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971913.545886:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.546041:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745331968 00000100:00100000:3.0:1790971913.546057:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745331968 00000100:00100000:3.0:1790971913.546208:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1790971913.546221:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:14434:x1877969745331968:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:3.0:1790971913.546262:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971913.547208:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7b0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.547327:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4aa13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.547345:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4aa13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.547360:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4aa13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971913.547407:0:14420:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790971913.547411:0:14420:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971913.547466:0:14420:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4aa13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.547515:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7b0 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.547540:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d600/0xbd3388eaa6f4aa13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7b0 expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.547550:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:3.0:1790971913.547553:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790971913.547573:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d600, rc 0) 00000100:00100000:3.0:1790971913.547664:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+10:14434:x1877969745331968:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 1445us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971913.547674:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:0.0:1790971913.572077:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.572267:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745332096 00000100:00100000:2.0:1790971913.572281:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745332096 00000100:00100000:2.0:1790971913.572356:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1790971913.572367:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+5:14435:x1877969745332096:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971913.572402:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971913.572429:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7b7 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.573024:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4aa21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.573042:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4aa21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.573052:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4aa21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971913.573090:0:14421:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790971913.573108:0:14421:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971913.573145:0:14421:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4aa21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.573176:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7b7 expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.573199:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fa00/0xbd3388eaa6f4aa21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7b7 expref: 6 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.573210:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:2.0:1790971913.573213:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790971913.573217:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fa00, rc 0) 00000100:00100000:2.0:1790971913.573347:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+6:14435:x1877969745332096:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 980us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971913.573355:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1790971913.577135:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.577623:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745332224 00000100:00100000:1.0:1790971913.577637:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745332224 00000100:00100000:1.0:1790971913.577717:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1790971913.577729:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15990494-edec-4067-b056-823ad473edfe+6:14435:x1877969745332224:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971913.577757:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971913.577782:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4aa28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7be expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.577882:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.577900:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.577913:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.577929:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.577936:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.577942:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.580292:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4aa3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.580319:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4aa3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.580334:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4aa3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971913.580382:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790971913.580386:0:14419:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971913.580412:0:14419:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4aa3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.584901:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.584925:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.584934:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.584940:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971913.584946:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.584955:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.584972:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:1.0:1790971913.584991:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971913.584996:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585002:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585022:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585028:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585034:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585039:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4afd42400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971913.585042:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585047:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585054:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cd496815500) 00010000:00010000:1.0:1790971913.585057:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971913.585060:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585065:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585118:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd43600/0xbd3388eaa6f4aa28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7be expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585157:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4aa3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7be expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.585165:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815200) 00010000:00010000:1.0:1790971913.585168:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971913.585170:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42200, rc 0) 00000100:00100000:1.0:1790971913.585250:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15990494-edec-4067-b056-823ad473edfe+7:14435:x1877969745332224:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 7522us (8139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971913.585259:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1790971913.597827:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.597940:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745332480 00000100:00100000:2.0:1790971913.597956:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745332480 00000100:00100000:2.0:1790971913.598028:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1790971913.598040:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15990494-edec-4067-b056-823ad473edfe+7:14435:x1877969745332480:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971913.598060:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971913.598080:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7c5 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971913.598182:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790971913.598303:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7c5 expref: 9 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.598336:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:2.0:1790971913.598339:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971913.598345:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7c5 expref: 9 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.598360:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fc00, rc 0) 00000100:00100000:2.0:1790971913.598438:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15990494-edec-4067-b056-823ad473edfe+8:14435:x1877969745332480:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 400us (626us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1790971913.598446:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1790971913.606714:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.606776:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745332736 00000100:00100000:3.0:1790971913.606786:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745332736 00000100:00100000:3.0:1790971913.606846:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1790971913.606855:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+8:14435:x1877969745332736:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:3.0:1790971913.606909:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971913.606934:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42200/0xbd3388eaa6f4aa3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7be expref: 8 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.606951:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815200) 00010000:00010000:3.0:1790971913.606974:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971913.606998:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.607010:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.607020:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790971913.607249:0:14420:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e747ab5c reply state 000000000b70d4a0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971913.607259:0:14420:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790971913.607267:0:14420:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790971913.607364:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15990494-edec-4067-b056-823ad473edfe+9:14435:x1877969745332736:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 509us (657us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790971913.607386:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1790971913.612858:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.613064:0:14422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745332992 00000100:00100000:3.0:1790971913.613089:0:14422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745332992 00000100:00100000:3.0:1790971913.613193:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:3.0:1790971913.613204:0:14422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15990494-edec-4067-b056-823ad473edfe+9:14435:x1877969745332992:12345-192.168.203.43@tcp:35:lfs.0 00010000:00010000:2.0:1790971913.613369:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.613384:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.613392:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.613399:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002c200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971913.613403:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.613411:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.613427:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd483040c00) 00010000:00010000:2.0:1790971913.613431:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790971913.613437:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.613453:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002c200/0xbd3388eaa6f4aa52 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971913.613607:0:14422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15990494-edec-4067-b056-823ad473edfe+9:14435:x1877969745332992:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 401us (755us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790971913.613617:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1790971913.616454:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.616702:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745333248 00000100:00100000:2.0:1790971913.616716:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745333248 00000100:00100000:2.0:1790971913.616787:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1790971913.616798:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+9:14435:x1877969745333248:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971913.616829:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971913.616857:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4aa59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7cc expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.616962:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.616982:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.616997:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617013:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617021:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617028:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971913.617184:0:14421:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790971913.617331:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617341:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617348:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617354:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5ec00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971913.617359:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617367:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617381:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:2.0:1790971913.617383:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971913.617389:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617395:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aa60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617411:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617417:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617423:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617439:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971913.617442:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617460:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617498:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cd4a656ce00) 00010000:00010000:2.0:1790971913.617501:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971913.617505:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617511:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aa67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617561:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4aa59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7cc expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617573:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:2.0:1790971913.617575:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971913.617579:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4aa59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7cc expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.617589:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5f400, rc 0) 00000100:00100000:2.0:1790971913.617823:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+10:14435:x1877969745333248:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1025us (1391us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790971913.617832:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1790971913.622020:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.622406:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745333376 00000100:00100000:1.0:1790971913.622420:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745333376 00000100:00100000:1.0:1790971913.622521:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1790971913.622531:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15990494-edec-4067-b056-823ad473edfe+10:14435:x1877969745333376:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1790971913.622562:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790971913.622592:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa75 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7d3 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.622704:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.622722:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.622746:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790971913.622779:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790971913.622791:0:14419:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790971913.622817:0:14419:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.622847:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42400/0xbd3388eaa6f4aa75 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.622869:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.622880:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:1.0:1790971913.622884:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790971913.622888:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4afd42800, rc 0) 00000100:00100000:1.0:1790971913.626248:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bddf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15990494-edec-4067-b056-823ad473edfe+11:14435:x1877969745333376:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 3700us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971913.626266:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1790971913.632520:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.632772:0:14422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745333504 00000100:00100000:3.0:1790971913.632786:0:14422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745333504 00000100:00100000:3.0:1790971913.632857:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:3.0:1790971913.632869:0:14422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15990494-edec-4067-b056-823ad473edfe+11:14435:x1877969745333504:12345-192.168.203.43@tcp:37:lfs.0 00000100:00100000:3.0:1790971913.640984:0:14422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15990494-edec-4067-b056-823ad473edfe+11:14435:x1877969745333504:12345-192.168.203.43@tcp:37:lfs.0 Request processed in 8100us (8509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971913.641002:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1790971913.647232:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.647684:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745333760 00000100:00100000:1.0:1790971913.647699:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745333760 00000100:00100000:1.0:1790971913.647770:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:1.0:1790971913.647782:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd384d6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15990494-edec-4067-b056-823ad473edfe+11:14435:x1877969745333760:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971913.648249:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd384d6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15990494-edec-4067-b056-823ad473edfe+12:14435:x1877969745333760:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 465us (1029us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790971913.648258:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1790971913.737390:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971913.737719:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745333888 00000100:00100000:0.0:1790971913.737732:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745333888 00000100:00100000:0.0:1790971913.737809:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1790971913.737821:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+10:14441:x1877969745333888:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971913.737849:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971913.737880:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4aa83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7da expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.737961:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.737979:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.737994:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738009:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738015:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738022:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738157:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6e00/0xbd3388eaa6f4aa98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738167:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6e00/0xbd3388eaa6f4aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738191:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6e00/0xbd3388eaa6f4aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971913.738226:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790971913.738230:0:16296:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971913.738272:0:16296:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6e00/0xbd3388eaa6f4aa98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738285:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738414:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738422:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738429:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971913.738434:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738443:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738515:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:0.0:1790971913.738518:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971913.738525:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738531:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aa8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738558:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738564:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738571:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738577:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971913.738580:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738586:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738593:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cd3866f7f00) 00010000:00010000:0.0:1790971913.738596:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971913.738598:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738604:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aa91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738644:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4aa83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7da expref: 12 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738658:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6e00/0xbd3388eaa6f4aa98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7da expref: 11 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.738678:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:0.0:1790971913.738680:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790971913.738683:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a6e00, rc 0) 00000100:00100000:0.0:1790971913.738775:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+11:14441:x1877969745333888:12345-192.168.203.43@tcp:101:bash.0 Request processed in 957us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971913.738784:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1790971913.743723:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971913.743815:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745334144 00000100:00100000:3.0:1790971913.743830:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745334144 00000100:00100000:3.0:1790971913.743909:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:3.0:1790971913.743919:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+11:14441:x1877969745334144:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971913.743955:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971913.743984:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4aa9f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7e1 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.744817:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.744860:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.744872:0:14420:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.744979:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971913.745000:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 11 pid: 14419 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971913.745019:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14420:1877969766291584:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971913.745615:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd49624b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790971913.764003:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971913.764155:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd495acfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14420:1877969766291584:192.168.203.43@tcp:104: 00010000:00010000:2.0:1790971913.764193:0:14420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971913.764763:0:14406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745334272 00000100:00100000:0.0:1790971913.764776:0:14406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745334272 00010000:00010000:0.0:1790971913.764831:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 12 pid: 14419 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971913.764883:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1790971913.764894:0:14406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15990494-edec-4067-b056-823ad473edfe+12:2356:x1877969745334272:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971913.764914:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971913.764922:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 12 pid: 14419 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.764937:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 12 pid: 14419 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.764963:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4afd42800/0xbd3388eaa6f4aa7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7d3 expref: 12 pid: 14419 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.764984:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:0.0:1790971913.765009:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.765022:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.765031:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.765065:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971913.765159:0:14406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15990494-edec-4067-b056-823ad473edfe+11:2356:x1877969745334272:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 265us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971913.765167:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00010000:00010000:2.0:1790971913.765423:0:14420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.765433:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.772366:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.772391:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.772404:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774754:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774776:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774787:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971913.774800:0:14420:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790971913.774837:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774859:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774866:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774871:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002de00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971913.774875:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774883:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774894:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:2.0:1790971913.774898:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971913.774902:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774908:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002de00/0xbd3388eaa6f4aaa6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790971913.774924:0:14420:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086dc8dfa reply state 00000000e2620aa3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971913.774933:0:14420:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790971913.774972:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4aa9f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 14 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.774986:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.775005:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971913.775007:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790971913.775009:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5ec00, rc 0) 00000100:00100000:2.0:1790971913.775093:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+14:14441:x1877969745334144:12345-192.168.203.43@tcp:101:bash.0 Request processed in 31174us (31383us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790971913.775103:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00010000:00010000:1.0:1790971913.782764:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.782783:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.786754:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.786762:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971913.786767:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.786778:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.786797:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cd4a656ce00) 00010000:00010000:1.0:1790971913.786801:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971913.786806:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971913.786812:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4aaad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971913.808304:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971913.808843:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745334400 00000100:00100000:0.0:1790971913.808857:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745334400 00000100:00100000:0.0:1790971913.808935:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1790971913.808946:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+13:14441:x1877969745334400:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971913.808981:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971913.809006:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aac2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7e8 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.809106:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4aac9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.809134:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.809149:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971913.809200:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790971913.809222:0:16296:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971913.809249:0:16296:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.809261:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.809292:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6000/0xbd3388eaa6f4aac2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e8 expref: 15 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.809314:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4aac9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e8 expref: 14 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971913.809335:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:0.0:1790971913.809338:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971913.809343:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7a00, rc 0) 00000100:00100000:0.0:1790971913.809426:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+14:14441:x1877969745334400:12345-192.168.203.43@tcp:101:bash.0 Request processed in 482us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971913.809434:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1790971913.814826:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.814944:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745334656 00000100:00100000:1.0:1790971913.814957:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745334656 00000100:00100000:1.0:1790971913.815042:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1790971913.815052:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+14:14441:x1877969745334656:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1790971913.815790:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd495acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+15:14441:x1877969745334656:12345-192.168.203.43@tcp:35:bash.0 Request processed in 734us (974us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790971913.815800:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1790971913.927366:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.927627:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745334912 00000100:00100000:1.0:1790971913.927641:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745334912 00000100:00100000:2.0:1790971913.930287:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1790971913.930321:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+15:14451:x1877969745334912:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1790971913.930357:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971913.930756:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7ef expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971913.930887:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790971913.944225:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aad0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7ef expref: 17 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.944251:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:2.0:1790971913.944254:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790971913.944259:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7ef expref: 17 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971913.944276:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e800, rc 0) 00000100:00100000:2.0:1790971913.946171:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:14451:x1877969745334912:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 15841us (18792us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1790971913.946190:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:0.0:1790971913.955603:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971913.959830:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745335168 00000100:00100000:1.0:1790971913.959876:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745335168 00000100:00100000:1.0:1790971913.959970:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1790971913.959982:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd387feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:14451:x1877969745335168:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1790971913.960408:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd387feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14451:x1877969745335168:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 427us (4821us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790971913.960419:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1790971914.039023:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971914.039184:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745335424 00000100:00100000:0.0:1790971914.039198:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745335424 00000100:00100000:0.0:1790971914.039342:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1790971914.039356:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14454:x1877969745335424:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971914.039392:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971914.039419:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4aade lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7f6 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971914.040832:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4aae5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971914.040880:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4aae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971914.040895:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4aae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971914.040910:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790971914.041497:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4aade lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7f6 expref: 20 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971914.041526:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4aae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7f6 expref: 19 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971914.041537:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:1.0:1790971914.041540:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790971914.041544:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7000, rc 0) 00000100:00100000:1.0:1790971914.041640:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:14454:x1877969745335424:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2285us (2643us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1790971914.044936:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1790971914.048996:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971914.049049:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971914.049150:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745335680 00000100:00100000:3.0:1790971914.049157:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745335552 00000100:00100000:3.0:1790971914.049163:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745335552 00000100:00100000:1.0:1790971914.049163:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745335680 00000100:00100000:3.0:1790971914.049239:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:1.0:1790971914.049239:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1790971914.049250:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:14454:x1877969745335552:12345-192.168.203.43@tcp:54:lfs.0 00000100:00100000:1.0:1790971914.049250:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:2356:x1877969745335680:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790971914.049271:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790971914.049314:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4aae5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7f6 expref: 20 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.049323:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.049339:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.049370:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971914.051887:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:1.0:1790971914.051941:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971914.052053:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:2356:x1877969745335680:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 2798us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971914.052067:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00010000:00010000:3.0:1790971914.054608:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.054633:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.054642:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.054650:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971914.054656:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.054668:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.054691:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:3.0:1790971914.054694:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971914.054700:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.054707:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aaf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971914.055004:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14454:x1877969745335552:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 5749us (6014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971914.055017:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1790971914.063073:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971914.063430:0:14422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745335936 00000100:00100000:3.0:1790971914.063616:0:14422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745335936 00000100:00100000:3.0:1790971914.063694:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1790971914.063706:0:14422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14454:x1877969745335936:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971914.064020:0:14422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:14454:x1877969745335936:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 314us (960us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1790971914.064029:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00010000:00010000:2.0:1790971914.087334:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790971914.475874:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971914.476183:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745336192 00000100:00100000:2.0:1790971914.476198:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745336192 00000100:00100000:2.0:1790971914.476280:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1790971914.476290:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:14486:x1877969745336192:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:2.0:1790971914.476322:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971914.476350:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aafa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a7fd expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.476929:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.477003:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.477017:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971914.477032:0:14421:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790971914.477400:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4aafa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7fd expref: 22 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.477424:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7fd expref: 21 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.477434:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971914.477437:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971914.477441:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5fc00, rc 0) 00000100:00100000:2.0:1790971914.478014:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+21:14486:x1877969745336192:12345-192.168.203.43@tcp:101:cat.0 Request processed in 1720us (2152us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790971914.478036:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1790971914.489425:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971914.489647:0:14422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745336448 00000100:00100000:3.0:1790971914.489661:0:14422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745336448 00000100:00100000:3.0:1790971914.489804:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1790971914.489817:0:14422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+21:14486:x1877969745336448:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1790971914.493701:0:14422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+22:14486:x1877969745336448:12345-192.168.203.43@tcp:35:cat.0 Request processed in 3871us (4274us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1790971914.493718:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1790971914.494284:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971914.494618:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745336576 00000100:00100000:2.0:1790971914.494631:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745336576 00000100:00100000:2.0:1790971914.494753:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1790971914.494765:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:2357:x1877969745336576:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971914.494784:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971914.494815:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7fd expref: 23 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.494841:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971914.494847:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971914.494904:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+22:2357:x1877969745336576:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 141us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971914.494911:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:0.0:1790971914.664638:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971914.664776:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745336832 00000100:00100000:2.0:1790971914.664789:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745336832 00000100:00100000:2.0:1790971914.664865:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1790971914.664877:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+21:14492:x1877969745336832:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:2.0:1790971914.664908:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971914.665057:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab0f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a804 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.665344:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.665363:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.665396:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971914.665409:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790971914.670819:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab0f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a804 expref: 24 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.670858:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a804 expref: 23 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971914.670869:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:3.0:1790971914.670873:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971914.670877:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4bdd5e800, rc 0) 00000100:00100000:3.0:1790971914.671337:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14492:x1877969745336832:12345-192.168.203.43@tcp:101:dd.0 Request processed in 6459us (6712us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1790971914.671348:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:1.0:1790971914.684702:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971914.701333:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745337088 00000100:00100000:2.0:1790971914.701347:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745337088 00000100:00100000:2.0:1790971914.701415:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1790971914.701422:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14492:x1877969745337088:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:2.0:1790971914.701614:0:16296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790971914.701643:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a804 expref: 23 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.701667:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4aac9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e8 expref: 22 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.701678:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971914.701682:0:16296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790971914.701964:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.701979:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.701989:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790971914.702054:0:16296:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1790971914.702083:0:16296:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000fcd7697 reply state 000000007d3d0ad8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971914.702109:0:16296:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790971914.702239:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14492:x1877969745337088:12345-192.168.203.43@tcp:36:dd.0 Request processed in 816us (17552us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1790971914.702245:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000020:00080000:2.0:1790971914.702249:0:16296:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790971914.710368:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.710392:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.710401:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.710408:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5f400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971914.710414:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.710424:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.710446:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971914.710450:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971914.710455:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971914.710462:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab24 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971914.847576:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971914.849012:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745337344 00000100:00100000:3.0:1790971914.849032:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745337344 00000100:00100000:3.0:1790971914.849136:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:3.0:1790971914.849156:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14492:x1877969745337344:12345-192.168.203.43@tcp:35:dd.0 00000100:00100000:3.0:1790971914.849551:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14492:x1877969745337344:12345-192.168.203.43@tcp:35:dd.0 Request processed in 397us (1989us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1790971914.849561:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1790971915.108846:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766292096:0@lo:400:kworker.0 00000100:00100000:2.0:1790971915.108974:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971915.109056:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790971915.109063:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766291712:0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.109335:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766291968:0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.109378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971915.109411:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790971915.109417:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766291840:0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.109452:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971915.109492:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766292352:0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.109517:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971915.109553:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766291968 00000100:00100000:0.0:1790971915.109562:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766291968 00000100:00100000:0.0:1790971915.109625:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766291840 00000100:00100000:0.0:1790971915.109628:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766291840 00000100:00100000:0.0:1790971915.109653:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790971915.109663:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766291968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.109753:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766291968:12345-0@lo:400:kworker.0 Request processed in 91us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.109760:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790971915.109779:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790971915.109786:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766291840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.109815:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766291840:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.109821:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790971915.109862:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766291840:0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.109873:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766291968:0@lo:400:kworker.0 00000100:00080000:0.0:1790971915.109925:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790971915.109930:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971915.109944:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766292096 00000100:00100000:0.0:1790971915.109948:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766292096 00000100:00100000:0.0:1790971915.109975:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766292352 00000100:00100000:0.0:1790971915.109978:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766292352 00000100:00080000:0.0:1790971915.109991:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790971915.110008:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790971915.110015:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766292096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.110049:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877969766292096:12345-0@lo:400:kworker.0 Request processed in 36us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.110055:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790971915.110065:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790971915.110250:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766292352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.110286:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1877969766292352:12345-0@lo:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.110302:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790971915.110328:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1877969766292352:0@lo:400:kworker.0 00000100:00100000:2.0:1790971915.110563:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971915.110590:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bddf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766292224:0@lo:400:kworker.0 00000100:00100000:2.0:1790971915.110612:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971915.110636:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877969766292096:0@lo:400:kworker.0 00000100:00100000:2.0:1790971915.110655:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766292224 00000100:00100000:2.0:1790971915.110658:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766292224 00000100:00080000:2.0:1790971915.110673:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790971915.110696:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790971915.110701:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766292224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971915.110800:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877969766292224:12345-0@lo:400:kworker.0 Request processed in 98us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971915.110807:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790971915.110833:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1877969766292224:0@lo:400:kworker.0 00010000:00010000:1.0:1790971915.111459:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971915.111491:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790971915.111506:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766292480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790971915.111552:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971915.111592:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766292480 00000100:00100000:1.0:1790971915.111598:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766292480 00000100:00100000:1.0:1790971915.111635:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790971915.111642:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766292480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971915.111679:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790971915.111719:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1877969766292480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971915.111737:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790971915.111777:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4a66b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1877969766292480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971915.112132:0:14411:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766291712 00000100:00100000:0.0:1790971915.112138:0:14411:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766291712 00000100:00100000:0.0:1790971915.112184:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790971915.112192:0:14411:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766291712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790971915.112251:0:14411:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e841c93-8375-413d-802b-5f81a8a5481c+19:3302:x1877969766291712:12345-0@lo:400:kworker.0 Request processed in 59us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.112258:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790971915.112683:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bddf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6e841c93-8375-413d-802b-5f81a8a5481c:3302:1877969766291712:0@lo:400:kworker.0 00000100:00100000:1.0:1790971915.151670:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971915.152463:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745337472 00000100:00100000:0.0:1790971915.152497:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745337472 00000100:00100000:0.0:1790971915.152578:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1790971915.152587:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14506:x1877969745337472:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:0.0:1790971915.152612:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971915.152631:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4ab2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a80b expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.152699:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.152714:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.152725:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.152739:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.152759:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.152766:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790971915.153382:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790971915.154642:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ab40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154658:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ab40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154667:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ab40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971915.154708:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790971915.154713:0:16296:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971915.154752:0:16296:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ab40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154764:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ab40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154772:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154779:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154786:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154804:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971915.154809:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154816:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154828:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:0.0:1790971915.154831:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971915.154835:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154842:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab32 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154854:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154859:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154865:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154871:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971915.154873:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154879:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154893:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cd3866f7f00) 00010000:00010000:0.0:1790971915.154895:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971915.154898:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.154903:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.155298:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4ab2b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a80b expref: 26 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.155312:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ab40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a80b expref: 25 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.155319:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:0.0:1790971915.155321:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790971915.155324:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7a00, rc 0) 00000100:00100000:0.0:1790971915.155386:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+25:14506:x1877969745337472:12345-192.168.203.43@tcp:101:stat.0 Request processed in 2800us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.155394:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000001:00080000:1.0:1790971915.211398:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:1.0:1790971915.211427:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1790971915.211433:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:1.0:1790971915.211459:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000100:00100000:1.0:1790971915.244069:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971915.244263:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745337728 00000100:00100000:3.0:1790971915.244277:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745337728 00000100:00100000:3.0:1790971915.244369:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:3.0:1790971915.244381:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+11:14512:x1877969745337728:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:3.0:1790971915.244463:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971915.244539:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ab40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a80b expref: 11 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.244564:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:3.0:1790971915.244570:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971915.244907:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.244936:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.244947:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790971915.245008:0:14421:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1790971915.245036:0:14421:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dae880a6 reply state 00000000c6df9235 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971915.245372:0:14421:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790971915.245583:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+13:14512:x1877969745337728:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 1202us (1525us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1790971915.245593:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000020:00080000:3.0:1790971915.245600:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790971915.251235:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971915.251281:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971915.251290:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971915.251297:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002ce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1790971915.251302:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971915.251311:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971915.251333:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:1.0:1790971915.251336:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790971915.251343:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971915.251349:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4ab47 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971915.409371:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971915.409651:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745337856 00000100:00100000:2.0:1790971915.409664:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745337856 00000100:00100000:2.0:1790971915.409748:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:2.0:1790971915.409761:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+12:14526:x1877969745337856:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:2.0:1790971915.409793:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971915.409823:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab4e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a812 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.409907:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.409940:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.409966:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.409987:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.409995:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410002:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410597:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410609:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410618:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971915.410672:0:14420:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1790971915.410677:0:14420:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971915.410707:0:14420:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410721:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410744:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410751:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410759:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410766:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5e800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971915.410771:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410780:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410794:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:2.0:1790971915.410797:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971915.410803:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410809:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5e800/0xbd3388eaa6f4ab55 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410823:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410830:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410835:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410846:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4bdd5fc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971915.410849:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410855:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410863:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cd4a656c000) 00010000:00010000:2.0:1790971915.410865:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971915.410868:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410874:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5fc00/0xbd3388eaa6f4ab5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410915:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5f400/0xbd3388eaa6f4ab4e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 14 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410930:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.410938:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971915.410941:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971915.410944:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d59600, rc 0) 00000100:00100000:2.0:1790971915.411036:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+13:14526:x1877969745337856:12345-192.168.203.43@tcp:101:stat.0 Request processed in 1276us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971915.411047:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1790971915.510065:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971915.510439:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745338112 00000100:00100000:3.0:1790971915.510455:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745338112 00000100:00100000:3.0:1790971915.510584:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1790971915.510596:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+13:14536:x1877969745338112:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1790971915.510631:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971915.510664:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ab6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a819 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971915.511173:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790971915.512457:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ab6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a819 expref: 15 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.512507:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:3.0:1790971915.512511:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790971915.512518:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ab6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a819 expref: 15 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.512539:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d200, rc 0) 00000100:00100000:3.0:1790971915.513328:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+14:14536:x1877969745338112:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2723us (3268us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1790971915.513342:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1790971915.516643:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971915.516765:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745338368 00000100:00100000:3.0:1790971915.516778:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745338368 00000100:00100000:3.0:1790971915.516894:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1790971915.516906:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd384d69050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+14:14536:x1877969745338368:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1790971915.517284:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd384d69050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+15:14536:x1877969745338368:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 378us (657us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1790971915.517293:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1790971915.608668:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971915.608892:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745338624 00000100:00100000:0.0:1790971915.608905:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745338624 00000100:00100000:0.0:1790971915.609036:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1790971915.609049:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+15:14542:x1877969745338624:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971915.609094:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971915.609130:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4ab78 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a820 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.609277:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.609296:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.609306:0:16296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.609316:0:16296:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.609357:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.609374:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 16 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971915.609402:0:16296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16296:1877969766292608:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971915.609572:0:16296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.609582:0:16296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 16 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971915.609592:0:16296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16296:1877969766292736:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971915.609629:0:16296:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886bd540 going to sleep for 11 seconds 00000100:00100000:1.0:1790971915.614615:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971915.614791:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745338752 00000100:00100000:3.0:1790971915.614803:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745338752 00010000:00010000:3.0:1790971915.614857:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 17 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971915.614905:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1790971915.614928:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd487873c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:2357:x1877969745338752:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790971915.614948:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971915.614956:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 17 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.614970:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 17 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.614998:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:3.0:1790971915.615004:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.615016:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.615047:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790971915.615152:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd487873c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:2357:x1877969745338752:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 237us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971915.615161:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00010000:00010000:0.0:1790971915.616660:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4bdd5ec00/0xbd3388eaa6f4aab4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a7e1 expref: 16 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971915.616689:0:16296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16296:1877969766292736:192.168.203.43@tcp:104: 00000100:00100000:1.0:1790971915.619714:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971915.619804:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745338880 00000100:00100000:2.0:1790971915.619842:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745338880 00010000:00010000:2.0:1790971915.619899:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 16 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971915.620027:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1790971915.620040:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:2357:x1877969745338880:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971915.620060:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971915.620078:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 16 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.620094:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 16 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.620133:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971915.620140:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.620152:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.620160:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.620183:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790971915.620371:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59600/0xbd3388eaa6f4ab63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a812 expref: 16 pid: 14420 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971915.620408:0:16296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16296:1877969766292608:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971915.620464:0:16296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.620503:0:16296:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.620510:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971915.620532:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1790971915.620728:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4ab78 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 17 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.620757:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 16 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.620764:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:0.0:1790971915.620767:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790971915.620769:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7e00, rc 0) 00000100:00100000:2.0:1790971915.626533:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:2357:x1877969745338880:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 6476us (6812us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971915.626553:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1790971915.626949:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+15:14542:x1877969745338624:12345-192.168.203.43@tcp:101:bash.0 Request processed in 17899us (18292us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1790971915.626960:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1790971915.633130:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971915.633438:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745339136 00000100:00100000:0.0:1790971915.633452:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745339136 00000100:00100000:0.0:1790971915.633546:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:0.0:1790971915.633558:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+15:14542:x1877969745339136:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:0.0:1790971915.633911:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.633936:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.633950:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790971915.634019:0:14421:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1790971915.634048:0:14421:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000046205d99 reply state 000000002be6118a transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971915.634058:0:14421:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971915.634192:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14542:x1877969745339136:12345-192.168.203.43@tcp:36:bash.0 Request processed in 635us (1087us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1790971915.634201:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000020:00080000:0.0:1790971915.634207:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790971915.640406:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.640452:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.640460:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.640467:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971915.640519:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.640531:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.640552:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971915.640555:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971915.640562:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.640569:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ab8d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971915.642676:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971915.643020:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745339264 00000100:00100000:2.0:1790971915.643034:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745339264 00000100:00100000:2.0:1790971915.643454:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1790971915.643468:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14542:x1877969745339264:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971915.643541:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971915.643578:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4ab94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a827 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.643656:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4ab94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a827 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.643690:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4ab94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a827 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.643714:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971915.643718:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971915.643723:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58400, rc 0) 00000100:00100000:2.0:1790971915.643791:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4a66b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14542:x1877969745339264:12345-192.168.203.43@tcp:101:bash.0 Request processed in 326us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971915.643798:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:1.0:1790971915.659816:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971915.659926:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745339392 00000100:00100000:3.0:1790971915.659939:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745339392 00000100:00100000:3.0:1790971915.660016:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:3.0:1790971915.660028:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14542:x1877969745339392:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1790971915.660058:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971915.660084:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ab9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a82e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.660207:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.660226:0:14419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 19 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.660236:0:14419:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.660294:0:14419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 19 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.660312:0:14419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 19 pid: 16296 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971915.660354:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14419:1877969766292864:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971915.660461:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093600 going to sleep for 11 seconds 00000100:00100000:1.0:1790971915.670060:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971915.670265:0:14406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745339520 00000100:00100000:0.0:1790971915.670281:0:14406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745339520 00010000:00010000:0.0:1790971915.670338:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 20 pid: 16296 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971915.670409:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1790971915.670420:0:14406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:2356:x1877969745339520:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790971915.670451:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971915.670460:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 20 pid: 16296 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.670512:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 20 pid: 16296 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.670541:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:0.0:1790971915.670546:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.670557:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.670566:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.670589:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971915.670663:0:14406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:2356:x1877969745339520:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 245us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.670671:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00010000:00010000:3.0:1790971915.671646:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ab7f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a820 expref: 19 pid: 16296 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971915.671672:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14419:1877969766292864:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971915.671702:0:14419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.671712:0:14419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.671717:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790971915.671778:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790971915.671783:0:14419:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790971915.671817:0:14419:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.671856:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ab9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a82e expref: 19 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.671875:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a82e expref: 18 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971915.671886:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:3.0:1790971915.671904:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790971915.671908:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002ce00, rc 0) 00000100:00100000:3.0:1790971915.671981:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14542:x1877969745339392:12345-192.168.203.43@tcp:101:bash.0 Request processed in 11953us (12181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971915.671992:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1790971915.678565:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971915.678710:0:14405:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745339776 00000100:00100000:2.0:1790971915.678725:0:14405:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745339776 00000100:00100000:2.0:1790971915.678816:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1790971915.678830:0:14405:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14542:x1877969745339776:12345-192.168.203.43@tcp:103:bash.0 00010000:00010000:2.0:1790971915.678867:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790971915.678901:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002ce00/0xbd3388eaa6f4aba2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a82e expref: 18 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.678930:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4ab94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a827 expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971915.678950:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971915.678966:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971915.679052:0:14405:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:14542:x1877969745339776:12345-192.168.203.43@tcp:103:bash.0 Request processed in 224us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971915.679061:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1790971915.681774:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971915.682042:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745339904 00000100:00100000:0.0:1790971915.682054:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745339904 00000100:00100000:0.0:1790971915.682150:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1790971915.682161:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:14542:x1877969745339904:12345-192.168.203.43@tcp:58:bash.0 00010000:00010000:0.0:1790971915.682326:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.682347:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.682362:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790971915.687233:0:16296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790971915.687434:0:16296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790971915.687550:0:16296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790971915.687706:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:14542:x1877969745339904:12345-192.168.203.43@tcp:58:bash.0 Request processed in 5538us (5937us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.687721:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1790971915.690544:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971915.690641:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745340032 00000100:00100000:0.0:1790971915.690655:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745340032 00000100:00100000:0.0:1790971915.690732:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1790971915.690744:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+16:14542:x1877969745340032:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1790971915.690775:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971915.690804:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a835 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.690882:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.690896:0:14421:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a835 expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.690926:0:14421:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.690961:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a835 expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.690980:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd3866f7f00) 00010000:00010000:0.0:1790971915.690984:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971915.690987:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a835 expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971915.690995:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7c00, rc 0) 00000100:00100000:0.0:1790971915.691083:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14542:x1877969745340032:12345-192.168.203.43@tcp:101:bash.0 Request processed in 341us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971915.691092:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00010000:00010000:1.0:1790971916.135067:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790971916.452723:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790971916.452732:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790971916.452769:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790971916.452775:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790971916.452890:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf11880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14452:1877969766292992:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790971916.452998:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971916.460314:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971916.460575:0:14430:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745340160 00000100:00100000:2.0:1790971916.460590:0:14430:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745340160 00000100:00100000:2.0:1790971916.460649:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1790971916.460659:0:14430:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14543:x1877969745340160:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790971916.460745:0:14430:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14543:x1877969745340160:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 87us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971916.460753:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1790971916.461429:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf11880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14452:1877969766292992:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790971916.469535:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971916.472784:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745340288 00000100:00100000:2.0:1790971916.472800:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745340288 00000100:00100000:2.0:1790971916.472949:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:2.0:1790971916.472960:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14543:x1877969745340288:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790971916.472991:0:14420:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790971916.473118:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14543:x1877969745340288:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 159us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971916.473127:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:1.0:1790971916.487155:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.487251:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745340416 00000100:00100000:0.0:1790971916.487266:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745340416 00000100:00100000:0.0:1790971916.487343:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:0.0:1790971916.487355:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14543:x1877969745340416:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.487427:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487445:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487456:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487509:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487536:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487544:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487566:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487574:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487594:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971916.487633:0:14421:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790971916.487637:0:14421:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790971916.487652:0:14421:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487664:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487671:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487678:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487683:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971916.487688:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487702:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487715:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040900) 00010000:00010000:0.0:1790971916.487717:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971916.487722:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487728:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4abb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487743:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487749:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487755:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487760:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971916.487762:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487768:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487775:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cd3866f7a00) 00010000:00010000:0.0:1790971916.487778:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971916.487781:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487796:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4abbe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487812:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487818:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487824:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487828:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971916.487831:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487836:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487843:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd3866f7f00) 00010000:00010000:0.0:1790971916.487845:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971916.487848:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.487854:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4abc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971916.487938:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14543:x1877969745340416:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 585us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.487946:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:1.0:1790971916.489883:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.489959:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745340672 00000100:00100000:0.0:1790971916.489968:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745340672 00000100:00100000:0.0:1790971916.490064:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:0.0:1790971916.490074:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14543:x1877969745340672:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.490092:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971916.490117:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4abcc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a83c expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490204:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490217:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490227:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971916.490238:0:16296:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790971916.490328:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490336:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490342:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490348:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971916.490352:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490359:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490381:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd3866f7f00) 00010000:00010000:0.0:1790971916.490384:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790971916.490388:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490394:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4abd3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490431:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4abcc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a83c expref: 19 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490440:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cd483040900) 00010000:00010000:0.0:1790971916.490443:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790971916.490447:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4abcc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a83c expref: 19 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.490456:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7000, rc 0) 00000100:00100000:0.0:1790971916.490536:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14543:x1877969745340672:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 463us (660us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1790971916.490543:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1790971916.498924:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.499009:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745340800 00000100:00100000:0.0:1790971916.499019:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745340800 00000100:00100000:0.0:1790971916.499142:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1790971916.499153:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14543:x1877969745340800:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790971916.499209:0:14421:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790971916.499314:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14543:x1877969745340800:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 162us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.499332:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:1.0:1790971916.506157:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971916.508151:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745341056 00000100:00100000:2.0:1790971916.508165:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745341056 00000100:00100000:2.0:1790971916.508285:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:2.0:1790971916.508296:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14543:x1877969745341056:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971916.508317:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971916.508339:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4abe1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a843 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790971916.509119:0:14420:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1790971916.509128:0:14420:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1790971916.509177:0:14420:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1790971916.509444:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58e00/0xbd3388eaa6f4abe8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.509459:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58e00/0xbd3388eaa6f4abe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.509496:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58e00/0xbd3388eaa6f4abe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.509555:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4abe1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a843 expref: 21 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.509578:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58e00/0xbd3388eaa6f4abe8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a843 expref: 20 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.509588:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:2.0:1790971916.509592:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790971916.509595:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58e00, rc 0) 00000100:00100000:2.0:1790971916.509653:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:14543:x1877969745341056:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1359us (3505us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1790971916.509661:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:1.0:1790971916.513498:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.513715:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745341312 00000100:00100000:3.0:1790971916.515414:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745341312 00000100:00100000:3.0:1790971916.515541:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1790971916.515553:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:14543:x1877969745341312:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790971916.515635:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790971916.515671:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58e00/0xbd3388eaa6f4abe8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a843 expref: 20 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.515702:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd4a656c400) 00010000:00010000:3.0:1790971916.515718:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790971916.515750:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.515768:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.515804:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.515824:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.515831:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.515838:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516128:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516143:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516150:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516156:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971916.516161:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516169:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516177:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:3.0:1790971916.516180:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971916.516184:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516195:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4abf6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516467:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516532:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516539:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516545:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971916.516548:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516555:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516566:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x255e0183 (ffff8cd483040f00) 00010000:00010000:3.0:1790971916.516568:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790971916.516571:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.516576:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d000/0xbd3388eaa6f4abfd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x255e0183 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971916.516697:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:14543:x1877969745341312:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1142us (3240us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790971916.516707:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1790971916.522544:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.522659:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745341440 00000100:00100000:0.0:1790971916.522673:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745341440 00000100:00100000:0.0:1790971916.522757:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1790971916.522771:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:14543:x1877969745341440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.522799:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971916.522831:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a84a expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.522880:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ac0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.522898:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ac0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.522912:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ac0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.523063:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a84a expref: 21 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.523088:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7e00/0xbd3388eaa6f4ac0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a84a expref: 20 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.523099:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:0.0:1790971916.523113:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790971916.523118:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7e00, rc 0) 00000100:00100000:0.0:1790971916.523201:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:14543:x1877969745341440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 433us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.523227:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1790971916.528035:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.528221:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745341696 00000100:00100000:0.0:1790971916.528236:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745341696 00000100:00100000:0.0:1790971916.528309:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1790971916.528320:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+20:14543:x1877969745341696:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.528435:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.528458:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.528494:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790971916.529037:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1790971916.529051:0:14421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 495468579895ns, next at 496468576685ns, rc = 0 00000004:00010000:0.0:1790971916.529163:0:14421:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000998c86f9 reply state 00000000c2bee0c2 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971916.529174:0:14421:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971916.529311:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+22:14543:x1877969745341696:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 989us (1289us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1790971916.529320:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00010000:00010000:3.0:1790971916.531724:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.531747:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.531756:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.531762:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1790971916.531767:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.531775:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.531794:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:3.0:1790971916.531797:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790971916.531803:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.531809:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6200/0xbd3388eaa6f4ac12 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971916.534332:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.534397:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745341824 00000100:00100000:0.0:1790971916.534411:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745341824 00000100:00100000:0.0:1790971916.534516:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:0.0:1790971916.534528:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+21:14543:x1877969745341824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.534561:0:16296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971916.534606:0:16296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a851 expref: -99 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.534684:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 22 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.534701:0:16296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 22 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.534726:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:0.0:1790971916.534730:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790971916.534734:0:16296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7400, rc 0) 00000100:00100000:0.0:1790971916.534813:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c032aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+22:14543:x1877969745341824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 287us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.534821:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:1.0:1790971916.537008:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.537179:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745341952 00000100:00100000:0.0:1790971916.537192:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745341952 00000100:00100000:0.0:1790971916.537357:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1790971916.537368:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2357:x1877969745341952:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790971916.537507:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790971916.537895:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2357:x1877969745341952:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 526us (898us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790971916.537905:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1790971916.542234:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.542403:0:14422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745342208 00000100:00100000:0.0:1790971916.542417:0:14422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745342208 00000100:00100000:0.0:1790971916.542649:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1790971916.542662:0:14422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+22:14543:x1877969745342208:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790971916.542986:0:14422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14543:x1877969745342208:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 326us (765us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790971916.543013:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1790971916.546313:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.546416:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745342464 00000100:00100000:3.0:1790971916.546428:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745342464 00000100:00100000:3.0:1790971916.546523:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1790971916.546535:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c0328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14543:x1877969745342464:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790971916.546673:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c0328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14543:x1877969745342464:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 140us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971916.546714:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:1.0:1790971916.548962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971916.549065:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745342592 00000100:00100000:2.0:1790971916.549078:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745342592 00000100:00100000:2.0:1790971916.549161:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1790971916.549171:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14543:x1877969745342592:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790971916.549195:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971916.549288:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4ac20 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a858 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.549607:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58a00/0xbd3388eaa6f4ac27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.549626:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58a00/0xbd3388eaa6f4ac27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.549644:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58a00/0xbd3388eaa6f4ac27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790971916.549697:0:14420:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790971916.549722:0:14420:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58a00/0xbd3388eaa6f4ac27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.549754:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58400/0xbd3388eaa6f4ac20 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a858 expref: 25 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.549782:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58a00/0xbd3388eaa6f4ac27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a858 expref: 24 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.549791:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:2.0:1790971916.549794:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790971916.549799:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d58a00, rc 0) 00000100:00100000:2.0:1790971916.549881:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14543:x1877969745342592:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 710us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971916.549889:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1790971916.553048:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.553181:0:15106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745342720 00000100:00100000:0.0:1790971916.553195:0:15106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745342720 00000100:00100000:0.0:1790971916.553270:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1790971916.553282:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2354:x1877969745342720:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.553308:0:15106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971916.553337:0:15106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a85f expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790971916.553371:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ac0100c, blocks: 0x1 00010000:00010000:0.0:1790971916.553408:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1790971916.553414:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971916.553426:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 7 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.553449:0:15106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 7 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.553466:0:15106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7000, rc 0) 00000100:00100000:0.0:1790971916.553575:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:2354:x1877969745342720:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 295us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.553582:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1790971916.556302:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.558203:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745342976 00000100:00100000:3.0:1790971916.558225:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745342976 00000100:00100000:1.0:1790971916.558534:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1790971916.558573:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14543:x1877969745342976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790971916.558781:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14543:x1877969745342976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 212us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971916.558790:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1790971916.561623:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.562081:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745343104 00000100:00100000:0.0:1790971916.562095:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745343104 00000100:00100000:0.0:1790971916.562183:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1790971916.562213:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14543:x1877969745343104:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790971916.602677:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14543:x1877969745343104:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 40451us (41051us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.602693:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000001:00080000:3.0:1790971916.603235:0:5861:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1790971916.603249:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790971916.603566:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790971916.603587:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766293120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790971916.603658:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971916.603781:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766293120 00000100:00100000:0.0:1790971916.603791:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766293120 00000100:00100000:0.0:1790971916.603860:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790971916.603871:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766293120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790971916.604501:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.604527:0:15671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745343232 00000100:00100000:3.0:1790971916.604532:0:15671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745343232 00000100:00100000:3.0:1790971916.604565:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1790971916.604572:0:15671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:2357:x1877969745343232:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790971916.604662:0:15671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:2357:x1877969745343232:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971916.604670:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00002000:00010000:0.0:1790971916.604972:0:15104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790971916.604976:0:15104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790971916.604978:0:15104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790971916.604980:0:15104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790971916 -> 1790971916 00002000:00010000:0.0:1790971916.604983:0:15104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790971916.605042:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1877969766293120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1172us (1383us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790971916.605049:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1790971916.605215:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cd4b70e8700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1790971916.605224:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766293120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790971916.609147:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.609532:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745343488 00000100:00100000:0.0:1790971916.609547:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745343488 00000100:00100000:0.0:1790971916.609609:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1790971916.609620:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdda3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+13:14543:x1877969745343488:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.609693:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790971916.609729:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d58a00/0xbd3388eaa6f4ac27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a858 expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.609759:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:0.0:1790971916.609765:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790971916.609835:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.609852:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.609864:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971916.610137:0:14419:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009f6c266d reply state 000000009f00c25d transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971916.610149:0:14419:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790971916.610284:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdda3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+14:14543:x1877969745343488:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 664us (1152us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1790971916.610293:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1790971916.616253:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.616447:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745343616 00000100:00100000:3.0:1790971916.616461:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745343616 00000100:00100000:3.0:1790971916.616572:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1790971916.616584:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:14543:x1877969745343616:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790971916.616610:0:15105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790971916.616639:0:15105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a866 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.616694:0:15105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 8 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.616705:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971916.616709:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790971916.616716:0:15105:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.616760:0:15105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 8 pid: 15106 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.616777:0:15105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 8 pid: 15106 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790971916.616794:0:15105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15105:1877969766293248:192.168.203.43@tcp:104: 00000100:00100000:3.0:1790971916.616906:0:15105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd381093900 going to sleep for 11 seconds 00010000:00010000:2.0:1790971916.618441:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.618510:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.618519:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.618526:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971916.618532:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.618542:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.618562:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:2.0:1790971916.618565:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971916.618570:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.618577:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6400/0xbd3388eaa6f4ac35 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971916.621050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.621199:0:15105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4bdf12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15105:1877969766293248:192.168.203.43@tcp:104: 00010000:00010000:3.0:1790971916.621257:0:15105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.621284:0:15105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd4a002d000, rc 0) 00000100:00100000:3.0:1790971916.621369:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:14543:x1877969745343616:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 4787us (5132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971916.621399:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1790971916.622243:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745343744 00000100:00100000:2.0:1790971916.622256:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745343744 00010000:00010000:2.0:1790971916.622306:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 8 pid: 15106 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971916.622353:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1790971916.622364:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:2357:x1877969745343744:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971916.622383:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971916.622429:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 8 pid: 15106 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.622444:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 8 pid: 15106 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.622505:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe53933c/0xbd3388eaa6f4ac2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a85f expref: 8 pid: 15106 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.622524:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971916.622528:0:14404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971916.622536:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 7 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.622547:0:14404:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 7 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.622593:0:14404:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 7 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971916.622611:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14404:1877969766293376:192.168.203.43@tcp:105: 00000100:00100000:2.0:1790971916.622702:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790971916.628594:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14404:1877969766293376:192.168.203.43@tcp:105: 00010000:00010000:1.0:1790971916.628632:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790971916.628714:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:2357:x1877969745343744:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 6350us (7678us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971916.628727:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1790971916.631653:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.631758:0:15104:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745343872 00000100:00100000:0.0:1790971916.631771:0:15104:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745343872 00000100:00100000:0.0:1790971916.631880:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1790971916.631893:0:15104:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:2354:x1877969745343872:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790971916.632190:0:15104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790971916.632194:0:15104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790971915 00002000:00010000:0.0:1790971916.632197:0:15104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790971913 00002000:00010000:0.0:1790971916.632199:0:15104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790971916 -> 1790971915 00002000:00010000:0.0:1790971916.632210:0:15104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790971916.632292:0:15104:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:2354:x1877969745343872:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 400us (829us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790971916.632301:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1790971916.639328:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.639446:0:15671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745344000 00000100:00100000:0.0:1790971916.639584:0:15671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745344000 00000100:00100000:0.0:1790971916.639707:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1790971916.639718:0:15671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:2357:x1877969745344000:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790971916.639784:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.639811:0:15671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.639820:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790971916.639825:0:15671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790971916.639831:0:15671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.639878:0:15671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.639896:0:15671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 8 pid: 15105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971916.639914:0:15671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15671:1877969766293504:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971916.640024:0:15671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483d46240 going to sleep for 11 seconds 00000100:00100000:1.0:1790971916.646498:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.646636:0:15671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15671:1877969766293504:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971916.646688:0:15671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971916.651213:0:14406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745344128 00000100:00100000:2.0:1790971916.651236:0:14406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745344128 00010000:00010000:2.0:1790971916.651323:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 9 pid: 15105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971916.651380:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1790971916.651391:0:14406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+9:2356:x1877969745344128:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971916.651411:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971916.651441:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 9 pid: 15105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.651460:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 9 pid: 15105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.651534:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4dbf5f7/0xbd3388eaa6f4ac3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x797c86479917a866 expref: 9 pid: 15105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.651556:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971916.651561:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790971916.651568:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.651579:0:14406:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.651630:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790971916.651713:0:14406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:2356:x1877969745344128:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 323us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971916.651733:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:0.0:1790971916.651946:0:15671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.651959:0:15671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.651992:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.652001:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.652010:0:15671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.652018:0:15671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6800 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:0.0:1790971916.652023:0:15671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.652033:0:15671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.652049:0:15671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.652072:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc11ee8b/0xbd3388eaa6f4ac43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971916.652192:0:15671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:2357:x1877969745344000:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 12476us (12878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.652203:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1790971916.659897:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971916.660126:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745344384 00000100:00100000:2.0:1790971916.660137:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745344384 00000100:00100000:2.0:1790971916.660193:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1790971916.660202:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+13:14543:x1877969745344384:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790971916.660281:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.660299:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.660311:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.662437:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.662903:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 14 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.662914:0:14420:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.662953:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 14 pid: 16296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.663071:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 14 pid: 16296 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971916.663088:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14420:1877969766293632:192.168.203.43@tcp:104: 00000100:00100000:0.0:1790971916.663218:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd483d46540 going to sleep for 11 seconds 00000100:00100000:0.0:1790971916.665786:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14420:1877969766293632:192.168.203.43@tcp:104: 00010000:00010000:0.0:1790971916.665831:0:14420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790971916.677241:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971916.677462:0:14404:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745344512 00000100:00100000:2.0:1790971916.677516:0:14404:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745344512 00010000:00010000:2.0:1790971916.677569:0:14404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 15 pid: 16296 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971916.677605:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1790971916.677615:0:14404:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+15:2357:x1877969745344512:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790971916.677631:0:14404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790971916.677637:0:14404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 15 pid: 16296 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.677649:0:14404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 15 pid: 16296 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.677688:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x797c86479917a851 expref: 15 pid: 16296 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.677705:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:2.0:1790971916.677710:0:14404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.677938:0:14404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.677948:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.678268:0:14404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790971916.678363:0:14404:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+14:2357:x1877969745344512:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 746us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.678372:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00010000:00010000:1.0:1790971916.678423:0:14420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790971916.678433:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790971916.678613:0:14420:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1790971916.678743:0:14420:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1790971916.678786:0:14420:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1790971916.678862:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14420:1877969766293760:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790971916.678955:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971916.679098:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4959e6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790971916.679172:0:14424:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766293760 00000100:00100000:3.0:1790971916.679178:0:14424:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766293760 00000100:00100000:3.0:1790971916.679216:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790971916.679224:0:14424:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1877969766293760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790971916.679308:0:14424:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1877969766293760:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971916.679314:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790971916.679429:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14420:1877969766293760:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790971916.680228:0:14420:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1790971916.680311:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14420:1877969766293888:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790971916.680363:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971916.680384:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886ef900 going to sleep for 11 seconds 00000100:00100000:0.0:1790971916.680401:0:14424:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766293888 00000100:00100000:0.0:1790971916.680408:0:14424:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766293888 00000100:00100000:0.0:1790971916.680452:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790971916.680462:0:14424:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1877969766293888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790971916.680464:0:14425:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1790971916.680501:0:14425:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1790971916.680641:0:14424:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14420:x1877969766293888:12345-0@lo:1000:mdt00_001.0 Request processed in 180us (277us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790971916.680649:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790971916.680688:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14420:1877969766293888:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790971916.680719:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680730:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680739:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680758:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971916.680763:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680772:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680787:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:2.0:1790971916.680791:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971916.680795:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680803:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6800/0xbd3388eaa6f4ac51 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680833:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680840:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680847:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680852:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a6c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971916.680855:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680862:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680883:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd3866f7f00) 00010000:00010000:2.0:1790971916.680886:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790971916.680893:0:14420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a835 expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680905:0:14420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a835 expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680914:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a835 expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.680940:0:14420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7c00/0xbd3388eaa6f4abb0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a835 expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971916.680951:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14420:1877969766294016:192.168.203.43@tcp:105: 00000100:00100000:2.0:1790971916.681029:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cd4886ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1790971916.686399:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.686500:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745344640 00000100:00100000:3.0:1790971916.686509:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745344640 00000100:00100000:3.0:1790971916.686560:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1790971916.686570:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14542:x1877969745344640:12345-192.168.203.43@tcp:49:bash.0 00000100:00100000:3.0:1790971916.686703:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+18:14542:x1877969745344640:12345-192.168.203.43@tcp:49:bash.0 Request processed in 134us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790971916.686710:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1790971916.686724:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14420:1877969766294016:192.168.203.43@tcp:105: 00010000:00010000:2.0:1790971916.686748:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686764:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a6c00/0xbd3388eaa6f4aba9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686802:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686815:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686839:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686849:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686856:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686862:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686868:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d59400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971916.686872:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686878:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686888:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd3866f7f00) 00010000:00010000:2.0:1790971916.686891:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790971916.686894:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.686899:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59400/0xbd3388eaa6f4ac58 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.687158:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.687165:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.687180:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.687185:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd487d59e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1790971916.687187:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.687193:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.687202:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd3866f7f00) 00010000:00010000:2.0:1790971916.687205:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790971916.687208:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.687213:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd487d59e00/0xbd3388eaa6f4ac4a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790971916.687693:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14543:x1877969745344384:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 27490us (27803us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1790971916.687702:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000020:00080000:2.0:1790971916.687706:0:14420:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790971916.688267:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790971916.688272:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790971916.688307:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790971916.688313:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790971916.691400:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971916.691699:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745344896 00000100:00100000:3.0:1790971916.691709:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745344896 00000100:00100000:3.0:1790971916.691889:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1790971916.691900:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+17:14543:x1877969745344896:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790971916.693263:0:14423:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790971916.693360:0:14423:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1790971916.693415:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.693879:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.693892:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.693901:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.693907:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.693914:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790971916.693944:0:14423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790971916.694067:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790971916.694075:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.694082:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd4a002d200 already unused, calling callback (ffffffffc163cac0) 00010000:00010000:2.0:1790971916.694086:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.694116:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.694129:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cd3866f7a00) 00010000:00010000:2.0:1790971916.694132:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790971916.694137:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.694143:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd4a002d200/0xbd3388eaa6f4ac5f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.694156:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971916.694158:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790971916.694160:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971916.694853:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:14543:x1877969745344896:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 2949us (3461us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1790971916.694864:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000020:00080000:3.0:1790971916.694871:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790971916.695185:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1790971916.695786:0:15106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745345024 00000100:00100000:2.0:1790971916.695795:0:15106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745345024 00000100:00100000:2.0:1790971916.695835:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971916.695844:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+7:14542:x1877969745345024:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1790971916.695859:0:15106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790971916.695878:0:15106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000986c0ebd/0xbd3388eaa6f4ac66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a86d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790971916.695903:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6ac0100b, atime: 0x6ac01009, ctime: 0x6ac0100b, blocks: 0x1 00010000:00010000:2.0:1790971916.695938:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1790971916.695943:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790971916.695952:0:15106:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000986c0ebd/0xbd3388eaa6f4ac66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a86d expref: 8 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.695987:0:15106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000986c0ebd/0xbd3388eaa6f4ac66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a86d expref: 8 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790971916.695999:0:15106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd487d59800, rc 0) 00000100:00100000:2.0:1790971916.696278:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:14542:x1877969745345024:12345-192.168.203.43@tcp:101:bash.0 Request processed in 433us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971916.696285:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1790971916.698751:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971916.698825:0:14422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745345280 00000100:00100000:1.0:1790971916.698836:0:14422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745345280 00000100:00100000:1.0:1790971916.698891:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1790971916.698910:0:14422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+19:14542:x1877969745345280:12345-192.168.203.43@tcp:35:bash.0 00000001:00080000:1.0:1790971916.699370:0:14422:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1790971916.699458:0:14422:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1790971916.699816:0:14422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+22:14542:x1877969745345280:12345-192.168.203.43@tcp:35:bash.0 Request processed in 914us (1072us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1790971916.699825:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000020:00080000:1.0:1790971916.699830:0:14422:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790971916.853966:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.854064:0:14419:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745345536 00000100:00100000:0.0:1790971916.854088:0:14419:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745345536 00000100:00100000:0.0:1790971916.854177:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1790971916.854188:0:14419:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4be2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+22:14553:x1877969745345536:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1790971916.855143:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790971916.855176:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797c86479917a874 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790971916.855379:0:14419:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790971916.855567:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a874 expref: 24 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.855584:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cd483040800) 00010000:00010000:0.0:1790971916.855588:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790971916.855612:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x797c86479917a874 expref: 24 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.855630:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cd3882a7a00, rc 0) 00000100:00100000:0.0:1790971916.855726:0:14419:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4be2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14553:x1877969745345536:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1538us (1774us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1790971916.855735:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:2.0:1790971916.865662:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.865779:0:16296:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745345664 00000100:00100000:0.0:1790971916.865792:0:16296:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745345664 00000100:00100000:0.0:1790971916.865867:0:16296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1790971916.865879:0:16296:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14553:x1877969745345664:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1790971916.865997:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866020:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866034:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866052:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866191:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866200:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866681:0:16296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866701:0:16296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866710:0:16296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790971916.866760:0:16296:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866774:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866782:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866789:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866796:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971916.866801:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866809:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866823:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cd496815500) 00010000:00010000:0.0:1790971916.866827:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971916.866832:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866839:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7a00/0xbd3388eaa6f4ac7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866862:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866868:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866874:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866880:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971916.866883:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.866890:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867850:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cd3866f7300) 00010000:00010000:0.0:1790971916.867861:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971916.867867:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867876:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7400/0xbd3388eaa6f4ac82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867917:0:16296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867925:0:16296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867932:0:16296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867952:0:16296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cd3882a7000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1790971916.867956:0:16296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867963:0:16296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867977:0:16296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cd3866f7f00) 00010000:00010000:0.0:1790971916.867980:0:16296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790971916.867983:0:16296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790971916.867989:0:16296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cd3882a7000/0xbd3388eaa6f4ac89 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790971916.868201:0:16296:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14553:x1877969745345664:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 2317us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790971916.868213:0:16296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1790971916.871656:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1790971916.871941:0:14423:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745345920 00000100:00100000:0.0:1790971916.871955:0:14423:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745345920 00000100:00100000:0.0:1790971916.872024:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1790971916.872037:0:14423:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+23:14553:x1877969745345920:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1790971916.872622:0:14423:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:14553:x1877969745345920:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 583us (974us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1790971916.872632:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:1.0:1790971917.157519:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971917.158628:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766294144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790971917.158808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971917.160497:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766294144 00000100:00100000:2.0:1790971917.160513:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766294144 00000100:00100000:2.0:1790971917.160653:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790971917.160665:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766294144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790971917.160721:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790971917.160861:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766294144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971917.160869:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790971917.162491:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd38518e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766294144:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790971917.164583:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790971918.204970:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971918.247943:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971918.247996:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971918.248021:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971918.248051:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971918.248070:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971918.248087:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971918.248129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971918.248183:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346304 00000100:00100000:3.0:1790971918.248196:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346304 00000100:00100000:3.0:1790971918.248262:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346816 00000100:00100000:3.0:1790971918.248266:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346816 00000100:00100000:3.0:1790971918.248286:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346432 00000100:00100000:3.0:1790971918.248289:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346432 00000100:00100000:3.0:1790971918.248303:0:15105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346688 00000100:00100000:3.0:1790971918.248305:0:15105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346688 00000100:00100000:3.0:1790971918.248326:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1790971918.248337:0:15105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2354:x1877969745346304:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971918.248428:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1790971918.248440:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745346816:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971918.248548:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745346816:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 110us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971918.248558:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1790971918.248571:0:14413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346048 00000100:00100000:1.0:1790971918.248576:0:14413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346048 00000100:00100000:2.0:1790971918.248590:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971918.248601:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:2354:x1877969745346432:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971918.248615:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:1.0:1790971918.248624:0:14413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:2354:x1877969745346048:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971918.248656:0:14413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b93ab65-9d8a-4fc9-bbe4-f950628eaf0f+13:2354:x1877969745346048:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971918.248662:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:1.0:1790971918.248697:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346560 00000100:00100000:1.0:1790971918.248701:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346560 00000100:00100000:1.0:1790971918.248728:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346176 00000100:00100000:1.0:1790971918.248731:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346176 00000100:00100000:1.0:1790971918.248753:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1790971918.248759:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+6:2354:x1877969745346560:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971918.248797:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15990494-edec-4067-b056-823ad473edfe+6:2354:x1877969745346560:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971918.248803:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1790971918.248814:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1790971918.248819:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:2354:x1877969745346176:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1790971918.248867:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+24:2354:x1877969745346176:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 45us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971918.248876:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1790971918.248925:0:15671:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1790971918.248935:0:15671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1790971918.248963:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:2354:x1877969745346432:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 363us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971918.248970:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1790971918.248985:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1790971918.248992:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745346688:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1790971918.249016:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15990494-edec-4067-b056-823ad473edfe+5:2354:x1877969745346688:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971918.249022:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00080000:1.0:1790971918.249277:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790971918.249284:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790971918.249287:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790971918.251335:0:15105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+5:2354:x1877969745346304:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 2986us (3324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971918.251354:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000001:02000400:3.0:1790971918.749847:0:16687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1790971919.204709:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790971919.783129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1790971919.783212:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1790971919.783656:0:15109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745346944 00000100:00100000:1.0:1790971919.783668:0:15109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745346944 00002000:00100000:1.0:1790971919.783722:0:15109:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8cd4bdf10700 x1877969745346944/t0(0) o4->e0176fed-bedb-4452-b9cc-4cbf4c411ab7@192.168.203.43@tcp:190/0 lens 504/0 e 0 to 0 dl 1790971930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1790971919.783735:0:15109:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bdf10700 with x1877969745346944 ext(0->8) 00002000:00010000:1.0:1790971919.783743:0:15109:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4bdf10700 00000100:00100000:1.0:1790971919.783772:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1790971919.783781:0:15109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+8:2357:x1877969745346944:12345-192.168.203.43@tcp:4:bash.0 00000100:00100000:1.0:1790971919.784359:0:15109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+10:2357:x1877969745346944:12345-192.168.203.43@tcp:4:bash.0 Request processed in 574us (1242us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1790971919.784368:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:1.0:1790971919.784376:0:15109:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8cd4bdf10700 x1877969745346944/t8589934598(0) o4->e0176fed-bedb-4452-b9cc-4cbf4c411ab7@192.168.203.43@tcp:190/0 lens 504/448 e 0 to 0 dl 1790971930 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1790971919.784385:0:15109:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cd4bdf10700 with x1877969745346944 ext(0->8) 00002000:00010000:1.0:1790971919.784395:0:15109:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cd4bdf10700 00000100:00100000:2.0:1790971919.787368:0:15106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969745347072 00000100:00100000:2.0:1790971919.787391:0:15106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969745347072 00000100:00100000:2.0:1790971919.787511:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1790971919.787523:0:15106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+10:2357:x1877969745347072:12345-192.168.203.43@tcp:16:kworker.0 00000001:00080000:0.0:1790971919.915367:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1790971919.915393:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1790971919.915405:0:7646:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:1.0:1790971919.922433:0:15106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0176fed-bedb-4452-b9cc-4cbf4c411ab7+6:2357:x1877969745347072:12345-192.168.203.43@tcp:16:kworker.0 Request processed in 132340us (136649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971919.922459:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1790971920.228781:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790971920.228815:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766294272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790971920.231236:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790971920.231417:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790971920.235544:0:15108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766294272 00000100:00100000:1.0:1790971920.235566:0:15108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766294272 00000100:00100000:1.0:1790971920.235672:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790971920.235683:0:15108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4bdf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766294272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790971920.235719:0:15108:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1790971920.235836:0:15108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4bdf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1877969766294272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (4611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971920.235843:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790971920.235871:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790971920.235927:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1790971920.235934:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cd4b70e8700, transno 8589934595 00000004:00080000:1.0:1790971920.235957:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1790971920.235991:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4be2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1877969766294272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790971920.243946:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766294656:0@lo:400:kworker.0 00000100:00100000:0.0:1790971920.244043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790971920.244100:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790971920.244107:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766294528:0@lo:400:kworker.0 00000100:00100000:0.0:1790971920.244138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790971920.244348:0:14421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766294656 00000100:00100000:1.0:1790971920.244358:0:14421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766294656 00000100:00100000:1.0:1790971920.244417:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790971920.244427:0:14421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766294656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971920.244536:0:14421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877969766294656:12345-0@lo:400:kworker.0 Request processed in 110us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971920.244544:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790971920.244572:0:15671:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766294528 00000100:00100000:1.0:1790971920.244576:0:15671:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766294528 00000100:00100000:1.0:1790971920.244616:0:15671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790971920.244642:0:15671:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4b70e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766294528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790971920.244678:0:15671:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4b70e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877969766294528:12345-0@lo:400:kworker.0 Request processed in 37us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790971920.244685:0:15671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790971920.244732:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1877969766294528:0@lo:400:kworker.0 00000100:00100000:1.0:1790971920.244744:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877969766294656:0@lo:400:kworker.0 00000100:00080000:1.0:1790971920.244794:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790971920.244999:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766294784:0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.245038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971920.245064:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790971920.245071:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e841c93-8375-413d-802b-5f81a8a5481c:3304:1877969766294400:0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.245113:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971920.245138:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cd4b70eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766294912:0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.245161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790971920.245205:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766294784 00000100:00100000:2.0:1790971920.245210:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766294784 00000100:00100000:2.0:1790971920.245243:0:14420:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766294912 00000100:00100000:2.0:1790971920.245247:0:14420:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766294912 00000100:00100000:2.0:1790971920.245266:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790971920.245272:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766294784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.245320:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1877969766294784:12345-0@lo:400:kworker.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971920.245327:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790971920.245342:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790971920.245348:0:14420:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd38518e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.245372:0:14420:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd38518e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1877969766294912:12345-0@lo:400:kworker.0 Request processed in 25us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971920.245378:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790971920.245395:0:14414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877969766294400 00000100:00100000:2.0:1790971920.245398:0:14414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877969766294400 00000100:00100000:2.0:1790971920.245423:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790971920.245429:0:14414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8cd4c1abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:3304:x1877969766294400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.245989:0:14414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8cd4c1abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e841c93-8375-413d-802b-5f81a8a5481c+19:3304:x1877969766294400:12345-0@lo:400:kworker.0 Request processed in 557us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790971920.245997:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790971920.246050:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6e841c93-8375-413d-802b-5f81a8a5481c:3304:1877969766294400:0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.246063:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1877969766294912:0@lo:400:kworker.0 00000100:00100000:2.0:1790971920.246087:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cd4b70e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1877969766294784:0@lo:400:kworker.0 00000100:00080000:2.0:1790971920.246131:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 Debug log: 29573 lines, 29573 kept, 0 dropped, 0 bad.